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Preface 


Numerical analysis is the branch of mathematics that is used to find approximations to difficult 
problems such as finding the roots of non-linear equations, integration involving complex 
expressions and solving differential equations for which analytical solutions do not exist. It is 
applied to a wide variety of disciplines such as business, all fields of engineering, computer science, 
education, geology, meteorology, and others. 

Years ago, high-speed computers did not exist, and if they did, the largest corporations could only 
afford them; consequently, the manual computation required lots of time and hard work. But now 
that computers have become indispensable for research work in science, engineering and other 
fields, numerical analysis has become a much easier and more pleasant task. 

This book is written primarily for students/readers who have a good background of high-school 
algebra, geometry, trigonometry, and the fundamentals of differential and integral calculus. A 
prior knowledge of differential equations is desirable but not necessary; this topic is reviewed in 
Chapter 5. 

One can use Fortran, Pascal, C, or Visual Basic or even a spreadsheet to solve a difficult problem. 
It is the opinion of this author that the best applications programs for solving engineering 
problems are 1) MATLAB which is capable of performing advanced mathematical and 
engineering computations, and 2) the Microsoft Excel spreadsheet since the versatility offered by 
spreadsheets have revolutionized the personal computer industry. We will assume that the reader 
has no prior knowledge of MATLAB and limited familiarity with Excel. 

We intend to teach the student/reader how to use MATLAB via practical examples and for 
detailed explanations he/she will be referred to an Excel reference book or the MATLAB User’s 
Guide. The MATLAB commands, functions, and statements used in this text can be executed 
with either MATLAB Student Version 12 or later. Our discussions are based on a PC with 
Windows XP platforms but if you have another platform such as Macintosh, please refer to the 
appropriate sections of the MATLAB’s User Guide that also contains instructions for installation. 

MATLAB is an acronym for MATrix LABoratory and it is a very large computer application 
which is divided to several special application fields referred to as toolboxes. In this book we will 
be using the toolboxes furnished with the Student Edition of MATLAB. As of this writing, the 
latest release is MATLAB Student Version Release 14 and includes SIMULINK which is a 


These topics are discussed in Mathematics for Business, Science, and Technology, Third Edition, ISBN 0-9709511 — 
0-8. This text includes probability and other advanced topics which are supplemented by many practical applications using 
Microsoft Excel and MATLAB. 





software package used for modeling, simulating, and analyzing dynamic systems. SIMULINK is 
not discussed in this text; the interested reader may refer to Introduction to Simulink with 
Engineering Applications, ISBN 0-9744239-7-1. Additional information including purchasing 
the software may be obtained from The MathWorks, Inc., 3 Apple Hill Drive, Natick, MA 
01760-2098. Phone: 508 647-7000, Fax: 508 647-7001, e-mail: info@mathwork.com and web 
site http://www.mathworks.com. 

The author makes no claim to originality of content or of treatment, but has taken care to present 
definitions, statements of physical laws, theorems, and problems. 

Chapter 1 is an introduction to MATLAB. The discussion is based on MATLAB Student Version 
5 and it is also applicable to Version 6. Chapter 2 discusses root approximations by numerical 
methods. Chapter 3 is a review of sinusoids and complex numbers. Chapter 4 is an introduction to 
matrices and methods of solving simultaneous algebraic equations using Excel and MATLAB. 
Chapter 5 is an abbreviated, yet practical introduction to differential equations, state variables, 
state equations, eigenvalues and eigenvectors. Chapter 6 discusses the Taylor and Maclaurin 
series. Chapter 7 begins with finite differences and interpolation methods. It concludes with 
applications using MATLAB. Chapter 8 is an introduction to linear and parabolic regression. 
Chapters 9 and 10 discuss numerical methods for differentiation and integration respectively. 
Chapter 11 is a brief introduction to difference equations with a few practical applications. 
Chapters 12 is devoted to partial fraction expansion. Chapters 13, 14, and 15 discuss certain 
interesting functions that find wide application in science, engineering, and probability. This text 
concludes with Chapter 16 which discusses three popular optimization methods. 

New to the Third Edition 

This is an extensive revision of the first edition. The most notable changes are the inclusion of 
Fourier series, orthogonal functions and factorization methods, and the solutions to all end-of- 
chapter exercises. It is in response to many readers who expressed a desire to obtain the solutions 
in order to check their solutions to those of the author and thereby enhancing their knowledge. 
Another reason is that this text is written also for self-study by practicing engineers who need a 
review before taking more advanced courses such as digital image processing. The author has 
prepared more exercises and they are available with their solutions to those instructors who adopt 
this text for their class. 

Another change is the addition of a rather comprehensive summary at the end of each chapter. 
Hopefully, this will be a valuable aid to instructors for preparation of view foils for presenting the 
material to their class. 

The last major change is the improvement of the plots generated by the latest revisions of the 
MATLAB® Student Version, Release 14. 

Orchard Publications 
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www. orchardpublications. com 
info@orchardpublications.com 
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Introduction to MATLAB 


Chapter 1 


T his chapter is an introduction of the basic MATLAB commands and functions, procedures 
for naming and saving the user generated files, comment lines, access to MATLAB’s Editor/ 
Debugger, finding the roots of a polynomial, and making plots. Several examples are pro¬ 
vided with detailed explanations. Throughout this text, a left justified horizontal bar will denote 
the beginning of an example, and a right justified horizontal bar will denote the end of the exam¬ 
ple. These bars will not be shown whenever an example begins at the top of a page or at the bot¬ 
tom of a page. Also, when one example follows immediately after a previous example, the right 
justified bar will be omitted. 

1.1 Command Window 

To distinguish the screen displays from the user commands, important terms and MATLAB func¬ 
tions, we will use the following conventions: 

Click: Click the left button of the mouse 
Courier Font: Screen displays 

Helvetica Font: User inputs at MATLAB’s command window prompt EDU> > 

Helvetica Bold: MATLAB functions 

Bold Italic: Important terms and facts, notes, and file names 

When we first start MATLAB, we see the toolbar on top of the command screen and the prompt 
EDU>>. This prompt is displayed also after execution of a command; MATLAB now waits for a 
new command from the user. We can use the Editor/Debugger to write our program, save it, and 
return to the command screen to execute the program as explained below. 

To use the Editor/Debugger: 

1. From the File menu on the toolbar, we choose New and click on M-File. This takes us to the 
Editor Window where we can type our script (list of statements) for a new file, or open a previ¬ 
ously saved file. We must save our program with a file name which starts with a letter. Impor¬ 
tant! MATLAB is case sensitive, that is, it distinguishes between upper- and lower-case let¬ 
ters. Thus, t and T are two different characters in MATLAB language. The files that we create 
are saved with the file name we use and the extension .m; for example, myfileOl.m. It is a good 


EDU>> is the MATLAB prompt in the Student Version. 
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Chapter 1 Introduction to MATLAB 

practice to save the script in a file name that is descriptive of our script content. For instance, if 
the script performs some matrix operations, we ought to name and save that file as 
matricesOl.m or any other similar name. We should also use a separate disk to backup our files. 

2. Once the script is written and saved as an m-file, we may exit the Editor/Debugger window by 
clicking on Exit Editor/Debugger of the File menu, and MATLAB returns to the command 
window. 

3. To execute a program, we type the file name without the .m extension at the EDU> > prompt; 
then, we press < enter > and observe the execution and the values obtained from it. If we have 
saved our file in drive a or any other drive, we must make sure that it is added it to the desired 
directory in MATLAB’s search path. The MATLAB User’s Guide provides more information 
on this topic. 

Henceforth, it will be understood that each input command is typed after the EDU > > prompt 
and followed by the < enter > key. 

The command help matlab iofun will display input/output information. To get help with other 
MATLAB topics, we can type help followed by any topic from the displayed menu. For example, to 
get information on graphics, we type help matlab graphics. We can also get help from the Help pull¬ 
down menu. The MATLAB User’s Guide contains numerous help topics. 

To appreciate MATLAB’s capabilities, we type demo and we see the MATLAB Demos menu. We 
can do this periodically to become familiar with them. Whenever we want to return to the com¬ 
mand window, we click on the Close button. 

When we are done and want to leave MATLAB, we type quit or exit. But if we want to clear all 
previous values, variables, and equations without exiting, we should use the clear command. This 
command erases everything; it is like exiting MATLAB and starting it again. The clc command 
clears the screen but MATLAB still remembers all values, variables and equations which we have 
already used. In other words, if we want MATLAB to retain all previously entered commands, but 
leave only the EDU > > prompt on the upper left of the screen, we can use the clc command. 

All text after the % (percent) symbol is interpreted by MATLAB as a comment line and thus it is 
ignored during the execution of a program. A comment can be typed on the same line as the func¬ 
tion or command or as a separate line. For instance, the statements 

conv(p,q) % performs multiplication of polynomials p and q 
% The next statement performs partial fraction expansion of p(x) / q(x) 

are both correct. 

One of the most powerful features of MATLAB is the ability to do computations involving com¬ 
plex numbers. We can use either i, or j to denote the imaginary part of a complex number, such as 
3 — 4i or 3 - 4j. For example, the statement 
z=3-4j 
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Roots of Polynomials 


displays 
z = 

3.0000 - 4 . OOOOi 

In the example above, a multiplication (*) sign between 4 and j was not necessary because the 
complex number consists of numerical constants. However, if the imaginary part is a function or 
variable such as cos(x), we must use the multiplication sign, that is, we must type cos(x)*j or 
j*cos(x). 

1.2 Roots of Polynomials 

In MATLAB, a polynomial is expressed as a row vector of the form [a n a n _ , a 2 a, a 0 ]. The 
elements of this vector are the coefficients of the polynomial in descending order. We must 
include terms whose coefficients are zero. 

We can find the roots of any polynomial with the roots(p) function where p is a row vector con¬ 
taining the polynomial coefficients in descending order. 


Example 1.1 

Find the roots of the polynomial 

p^x) = x 4 - 10x 3 + 35x 2 - 50x + 24 (1.1) 

Solution: 

The roots are found with the following two statements. We have denoted the polynomial as pi, 
and the roots as roots_ pi. 

p1=[1 -10 35 -50 24] % Specify the coefficients of pi (x) 

pi = 

1 -10 35 -50 24 

roots_ p1=roots(p1) % Find the roots of pi (x) 

roots_pl = 

4.0000 

3.0000 

2.0000 

1.0000 


We observe that MATLAB displays the polynomial coefficients as a row vector, and the roots as 
column vector. 
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Example 1.2 

Find the roots of the polynomial 

p 2 (x) = x 5 — 7x 4 + 16x 2 + 25x + 52 (1.2) 

Solution: 

There is no cube term; therefore, we must enter zero as its coefficient. The roots are found with the 
statements below where we have defined the polynomial as p2, and the roots of this polynomial as 

roots_ p2. 

p2=[1 -7 0 16 25 52] 

p2 = 

1-7 0 16 25 52 

roots_ p2=roots(p2) 

roots_ p2 = 

6.5014 

2.7428 

-1.5711 

-0.3366 + 1.3202i 
-0.3366 - 1.3202i 

The result indicates that this polynomial has three real roots, and two complex roots. Of course, 
complex roots always occur in complex conjugate pairs. 


1.3 Polynomial Construction from Known Roots 

We can compute the coefficients of a polynomial from a given set of roots with the poly(r) func¬ 
tion where r is a row vector containing the roots. 


Example 1.3 

It is known that the roots of a polynomial are 1, 2, 3, and 4. Compute the coefficients of this 
polynomial. 

Solution: 

We first define a row vector, say r3 , with the given roots as elements of this vector; then, we find 
the coefficients with the poly(r) function as shown below. 


* By definition, the conjugate of a complex number A = a + jb is A* = a — jb 
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Evaluation of a Polynomial at Specified Values 
r3=[1 2 3 4] % Specify the roots of the polynomial 

r3 = 

12 3 4 

poly_r3=poly(r3) % Find the polynomial coefficients 

poly_r3 = 

1 -10 35 -50 24 

We observe that these are the coefficients of the polynomial p,(x) of Example 1.1. 


Example 1.4 

It is known that the roots of a polynomial are — 1, -2, -3, 4 + j5, and 4 — j5 . Find the coeffi¬ 
cients of this polynomial. 

Solution: 

We form a row vector, say r4, with the given roots, and we find the polynomial coefficients with 
the poly(r) function as shown below. 

r4=[ -1 -2 -3 4+5j 4-5j ] 
r4 = 

Columns 1 through 4 

-1.0000 -2.0000 -3.0000 -4.0000 + 5.0000i 

Column 5 

-4.0000 - 5.OOOOi 

poly_r4=poly(r4) 

poly_r4 = 

1 14 100 340 499 246 

Therefore, the polynomial is 

p 4 (x) = x 5 + 14x 4 + 100x 3 + 340x 2 + 499x + 246 (1.3) 


1.4 Evaluation of a Polynomial at Specified Values 

The polyval(p,x) function evaluates a polynomial p(x) at some specified value of the indepen¬ 
dent variable x. 
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Example 1.5 

Evaluate the polynomial 

p 5 (x) = x 6 - 3x 5 + 5x 3 - 4x 2 + 3x + 2 (1.4) 

at x = -3 . 

Solution: 

p5=[1 -3 0 5 -4 3 2]; % These are the coefficients 

% The semicolon (;) after the right bracket suppresses the display of the row vector 
% that contains the coefficients of p5. 

% 

val_minus3=polyval(p5, -3)% Evaluate p5 at x=-3. No semicolon is used here 
% because we want the answer to be displayed 

val_minus3 = 

1280 


Other MATLAB functions used with polynomials are the following: 
conv(a,b) - multiplies two polynomials a and b 

[q,r]=deconv(c,d) -divides polynomial c by polynomial d and displays the quotient q and remain¬ 
der r. 

polyder(p) - produces the coefficients of the derivative of a polynomial p. 


Example 1.6 
Let 

Pi = x 5 -3x 4 + 5x 2 + 7x + 9 
p 2 = 2 x 6 -8x 4 + 4x 2 + lOx + 12 
Compute the product pi • p 2 with the conv(a,b) function. 

Solution: 

p1=[1 -3 0 5 7 9]; 
p2=[2 0 -8 0 4 10 12]; 
pi p2=conv(p1 ,p2) 

plp2 = 

2 -6 -8 34 18 -24 -74 -88 78 166 174 108 

Therefore, 
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Pi P P 2 = 2X 11 - 6x 10 - 8x 9 + 34x 8 + 18x 7 - 24x 6 

-74x 5 -88x 4 + 78x 3 + 166x 2 + 174x + 108 


We can write MATLAB statements in one line if we separate them by commas or semicolons. 

Commas will display the results whereas semicolons will suppress the display. 


Example 1.7 
Let 

p 3 = x 7 -3x 5 + 5x 3 + 7x + 9 
p 4 = 2x 6 - 8x 5 + 4x 2 + 10x + 12 
Compute the quotient p 3 /p 4 using the deconv(p,q) function. 

Solution: 

p3=[1 0 -3 0 5 7 9]; p4=[2 -8 0 0 4 10 12]; [q,r]=deconv(p3,p4) 

q = 

0.5000 

r = 

0 4 -3 0 3 2 3 

Therefore, the quotient q(x) and remainder r(x) are 

q(x) = 0.5 r(x) = 4x 5 - 3x 4 + 3x 2 + 2x + 3 


Example 1.8 
Let 

p 5 = 2x 6 - 8x 4 + 4x 2 + lOx + 12 (1.7) 

Compute the derivative dp 5 /dx using the polyder(p) function. 

Solution: 

p5=[2 0 -8 0 4 10 12]; 
der_p5=polyder(p5) 

der_p5 = 

12 0 -32 0 8 10 

Therefore, 
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dp 5 /dx = 12x 5 - 32x 3 + 4x 2 + 8x + 10 


1.5 Rational Polynomials 

Rational Polynomials are those which can be expressed in ratio form, that is, as 

R( x ) = Num(x) = b n x n + b n _ 1 x n ~ 1 + b n _ 2 x n ~ 2 + ... + b t x + b 0 ^ ^ 

Den(x) a m x m + a m _ 1 x m_1 + a m _ 2 x m_2 + ... + aiX + a 0 

where some of the terms in the numerator and/or denominator may be zero. We can find the roots 
of the numerator and denominator with the roots (p) function as before. 


Example 1.9 
Let 

R( x ) = Ebhe = x 5 -3x 4 + 5x 2 + 7x + 9 

Pden 2x 6 - 8x 4 + 4x 2 + lOx + 12 

Express the numerator and denominator in factored form, using the roots(p) function. 

Solution: 


(1.9) 


num=[1 -3 0 5 7 9]; den=[2 0 -8 0 4 10 12];% Do not display num and den coefficients 
roots_num=roots(num), roots_den=roots(den) % Display num and den roots 

roots_num - 

2.4186 + 1.0712i 2.4186 - 1.0712i -1.1633 

-0.3370 + 0.99611 -0.3370 - 0.99611 


roots_den - 

1.6760 + 0.4922i 1.6760 - 0.4922i -1.9304 

-0.2108 + 0.9870i -0.2108 - 0.9870i -1.0000 


As expected, the complex roots occur in complex conjugate pairs. 
For the numerator, we have the factored form 


Pnum = (x-2.4186-jl.0712) • (x-2.4186 + j 1.0712) • (x + 1.1633) • 
(x + 0.3370 - j0.9961) • (x + 0.3370 + j0.9961) 
and for the denominator, we have 


Pden = (x-1.6760 - j0.4922) • (x-1.6760 + j0.4922) • (x + 1.9304) • 
(x + 0.2108-j0.9870) • (x + 0.2108 + j0.9870) • (x + 1.0000) 
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We can also express the numerator and denominator of this rational function as a combination of 
linear and quadratic factors. We recall that in a quadratic equation of the form 
x 2 + bx + c = 0 whose roots are x 1 and x 2 , the negative sum of the roots is equal to the coef¬ 
ficient b of the x term, that is, —(x, + x 2 ) = b, while the product of the roots is equal to the 
constant term c, that is, x t • x 2 = c. Accordingly, we form the coefficient b by addition of the 
complex conjugate roots and this is done by inspection; then we multiply the complex conjugate 
roots to obtain the constant term c using MATLAB as indicated below. 

(2.4186+1.0712i)*(2.4186 —1.0712i) % Form the product of the 1st set of complex conjugates 

ans = 6.9971 

(-0.3370+0.9961 i)*(—0.3370—0.9961 i) % Form the product of the 2nd set of complex conjugates 
ans = 1.1058 
(1.6760+0.4922i)*(1.6760-0.49221) 

ans = 3.0512 

(-0.2108+0.9870i)*(-0.2108-0.9870i) 

ans = 1.0186 


1.6 Using MATLAB to Make Plots 

Quite often, we want to plot a set of ordered pairs. This is a very easy task with the MATLAB 
plot(x,y) command which plots y versus x. Here, x is the horizontal axis (abscissa) and y is the 
vertical axis (ordinate). 


Example 1.10 

Consider the electric circuit of Figure 1.1, where the radian frequency (0 (radians/second) of the 
applied voltage was varied from 300 to 3000 in steps of 100 radians/second, while the amplitude 
was held constant. The ammeter readings were then recorded for each frequency. The magnitude 
of the impedance |Z| was computed as |Z| = |V/A| and the data were tabulated in Table 1.1. 

Plot the magnitude of the impedance, that is, |Z| versus radian frequency to. 

Solution: 

We cannot type (0 (omega) in the MATLAB command window, so we will use the English letter 
w instead. 
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Figure 1.1. Electric circuit for Example 1.10 


TABLE 1.1 Table for Example 1.10 


(0 (rads/s) 

JZ| 

00 (rads/s) 

Oh 

300 

39.339 

1700 

90.603 

400 

52.589 

1800 

81.088 

500 

71.184 

1900 

73.588 

600 

97.665 

2000 

67.513 

700 

140.437 

2100 

62.481 

800 

222.182 

2200 

58.240 

900 

436.056 

2300 

54.611 

1000 

1014.938 

2400 

51.428 

1100 

469.83 

2500 

48.717 

1200 

266.032 

2600 

46.286 

1300 

187.052 

2700 

44.122 

1400 

145.751 

2800 

42.182 

1500 

120.353 

2900 

40.432 

1600 

103.111 

3000 

38.845 


If a statement, or a row vector is too long to fit in one line, it can be continued to the next line by 
typing three or more periods, then pressing <enter> to start a new line, and continue to enter 
data. This is illustrated below for the data of w and z. Also, as mentioned before, we use the semi¬ 
colon (;) to suppress the display of numbers which we do not care to see on the screen. 

The data are entered as follows: 

w=[300 400 500 600 700 800 900 1000 1100 1200 1300 1400.... % Use 4 periods to continue 
1500 1600 1700 1800 1900 2000 2100 2200 2300 2400 2500.... 
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2600 2700 2800 2900 3000]; % Use semicolon to suppress display of these numbers 

% 

z=[39.339 52.789 71.104 97.665 140.437 222.182 436.056.... 

1014.938 469.830 266.032 187.052 145.751 120.353 103.111.... 

90.603 81.088 73.588 67.513 62.481 58.240 54.611 51.468.... 

48.717 46.286 44.122 42.182 40.432 38.845]; 

Of course, if we want to see the values of w or z or both, we simply type w or z, and we press 
<enter>. 

To plot z (y - axis) versus w (x - axis), we use the plot(x,y) command. For this example, we use 
plot(w,z). When this command is executed, MATLAB displays the plot on MATLAB’s graph 
screen. This plot is shown in Figure 1.2. 



Figure 1.2. Plot of impedance |z| versus frequency co for Example 1.10 
This plot is referred to as the amplitude frequency response of the circuit. 


To return to the command window, we press any key, or from the Window pull-down menu, we 
select MATLAB Command Window. To see the graph again, we click on the Window pull-down 
menu, and we select Figure. 

We can make the above, or any plot, more presentable with the following commands: 

grid on: This command adds grid lines to the plot. The grid off command removes the grid. The 

command grid toggles them, that is, changes from off to on or vice versa. The default is off. 


* Default is a particular value for a variable or condition that is assigned automatically by an operating system, and remains 
in effect unless canceled or overridden by the operator. 
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box off: This command removes the box (the solid lines which enclose the plot), and box on 
restores the box. The command box toggles them. The default is on. 

title(‘string’): This command adds a line of the text string (label) at the top of the plot. 
xlabel(‘string’) and ylabel(‘string’) are used to label the x- and y-axis respectively. 

The amplitude frequency response is usually represented with the x-axis in a logarithmic scale. 
We can use the semilogx(x,y) command that is similar to the plot(x,y) command, except that the 
x-axis is represented as a log scale, and the y-axis as a linear scale. Likewise, the semilogy(x,y) 
command is similar to the plot(x,y) command, except that the y-axis is represented as a log scale, 
and the x-axis as a linear scale. The loglog(x,y) command uses logarithmic scales for both axes. 

Throughout this text, it will be understood that log is the common (base 10) logarithm, and In is 
the natural (base e) logarithm. We must remember, however, the function log(x) in MATLAB is 
the natural logarithm, whereas the common logarithm is expressed as Iog10(x). Likewise, the loga¬ 
rithm to the base 2 is expressed as log2(x). 

Let us now redraw the plot with the above options, by adding the following statements: 

semilogx(w,z); grid; % Replaces the plot(w,z) command 
title('Magnitude of Impedance vs. Radian Frequency 1 ); 
xlabelfw in rads/sec 1 ); ylabel('|Z| in Ohms') 

After execution of these commands, our plot is as shown in Figure 1.3. 



Figure 1.3. Modified frequency response plot of Figure 1.2. 

If the y-axis represents power, voltage, or current, the x-axis of the frequency response is more 
often shown in a logarithmic scale, and the y-axis in dB (decibels) scale. A review of the decibel 
unit follows. 
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The ratio of any two values of the same quantity (power, voltage, or current) can be expressed in 
decibels (dB). Thus, we say that an amplifier has 10 dB power gain, or a transmission line has a 
power loss of 7 dB (or gain -7 dB). If the gain (or loss) is 0 dB the output is equal to the input. 
By definition, 


dB = 10 log 

P out 


P~ 


( 1 . 10 ) 


Therefore, 

10 dB represents a power ratio of 10 
lOn dB represents a power ratio of 10 n 
It is very useful to remember that: 

20 dB represents a power ratio of 100 
30 dB represents a power ratio of 1, 000 
60 dB represents a power ratio of 1, 000, 000 
Also, 

1 dB represents a power ratio of approximately 1.25 

3 dB represents a power ratio of approximately 2 
7 dB represents a power ratio of approximately 5 
From these, we can estimate other values. For instance, 

4 dB = 3 dB + 1 dB and since 3 dB = power ratio of 2 and 1 dB = power ratio of 1.25 
then, 4 dB = ratio of (2 x 1.25) = ratio of 2.5 

Likewise, 27 dB = 20 dB + 7 dB and this is equivalent to a power ratio of approximately 
100x5 = 500 
Using the relations 

and 


y = logx = 21ogx 


p = y = rz 

if we let Z = 1, the dB values for voltage and current ratios become 
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dB v = 101og|Ys« 

| Vin 

2 = 20 log 

fel 

(l.ii) 

dB, = lOlogipij 

2 = 20 log 

a 

(1.12) 


To display the voltage v in a dB scale on the y - axis, we add the relation dB=20*log10(v), and we 
replace the semilogx(w,z) command with semilogx(w,dB). 

The command gtext(‘string’) switches to the current Figure Window, and displays a cross-hair 
which can be moved around with the mouse. For instance, we can use the command 
gtext(‘lmpedance \Z\ versus Frequency’), and this will place a cross-hair in the Figure window. 
Then, using the mouse, we can move the cross-hair to the position where we want our label to 
begin, and we press < enter >. 

The command text(x,y,’string’) is similar to gtext(‘string’). It places a label on a plot in some spe¬ 
cific location specified by x and y, and string is the label which we want to place at that location. 
We will illustrate its use with the following example which plots a 3-phase sinusoidal waveform. 

The first line of the script below has the form 

linspace(first_value, last_value, number_of_values) 

This command specifies the number of data points but not the increments between data points. An 
alternate command uses the colon notation and has the format 

x=first: increment: last 

This format specifies the increments between points but not the number of data points. 

The script for the 3-phase plot is as follows: 

x=linspace(0, 2*pi, 60); % pi is a built-in function in MATLAB; 

% we could have used x=0:0.02*pi:2*pi or x = (0: 0.02: 2)*pi instead; 
y=sin(x); u=sin(x+2*pi/3); v=sin(x+4*pi/3); 

plot(x,y,x,u,x,v); % The x-axis must be specified for each function 
grid on, box on, % turn grid and axes box on 

text(0.75, 0.65, 'sin(x)'); text(2.85, 0.65, 'sin(x+2*pi/3)'); text(4.95, 0.65, 'sin(x+4*pi/3)') 

These three waveforms are shown on the same plot of Figure 1.4. 

In our previous examples, we did not specify line styles, markers, and colors for our plots. However, 
MATLAB allows us to specify various line types, plot symbols, and colors. These, or a combination 
of these, can be added with the plot(x,y,s) command, where s is a character string containing one or 
more characters shown on the three columns of Table 1.2. 

MATLAB has no default color; it starts with blue and cycles through the first seven colors listed in 
Table 1.2 for each additional line in the plot. Also, there is no default marker; no markers are 
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drawn unless they are selected. The default line is the solid line. 



Figure 1.4. Three-phase waveforms 


TABLE 1.2 Styles, colors, and markets used in MATLAB 


Symbol 

Color 

Symbol 

Marker 

Symbol 

Line Style 

b 

blue 


point 

- 

solid line 

g 

green 

o 

circle 


dotted line 

r 

red 

x 

x—mark 


dash—dot line 

c 

cyan 

+ 

plus 

— 

dashed line 

m 

magenta 

* 

star 



y 

yellow 

S 

square 



k 

black 

d 

diamond 



w 

white 

/ 

triangle down 





Y 

triangle up 





< 

triangle left 





> 

triangle right 





P 

pentagram 





h 

hexagram 




For example, the command plot(x,y,'m*: 1 ) plots a magenta dotted line with a star at each data 
point, and plot(x,y,'rs') plots a red square at each data point, but does not draw any line because 
no line was selected. If we want to connect the data points with a solid line, we must type 
plot(x,y,'rs- 1 ). For additional information we can type help plot in MATLAB’s command screen. 
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The plots which we have discussed thus far are two-dimensional, that is, they are drawn on two 
axes. MATLAB has also a three-dimensional (three-axes) capability and this is discussed next. 

The command plot3(x,y,z) plots a line in 3-space through the points whose coordinates are the 
elements of x, y, and z, where x, y, and z are three vectors of the same length. 

The general format is plot3(x 1 ,y 1 ,z 1 ,Si,X2,y2,Z2,S2,X3,y3,z 3 ,S3,...) where x n , y n , and z n are vectors 
or matrices, and s n are strings specifying color, marker symbol, or line style. These strings are the 
same as those of the two-dimensional plots. 


Example 1.11 
Plot the function 

z = -2x 3 + xT3y 2 -l (1.13) 

Solution: 

We arbitrarily choose the interval (length) shown with the script below. 

x= -10: 0.5:10; % Length of vector x 

y= x; % Length of vector y must be same as x 

z=-2.*x. A 3+x+3.*y. A 2-1; % Vector z is function of both x and y* 

plot3(x,y,z); grid 

The three-dimensional plot is shown in Figure 1.5. 



Figure 1.5. Three dimensional plot for Example 1.11 


* This statement uses the so called dot multiplication, dot division, and dot exponentiation where these operations are preceded 
by a dot (period). These operations will be explained in Section 1.8, Page 1—19. 
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The command plot3(x,y,z,'bd-') will display the plot in blue diamonds, connected with a solid 
line. 

In a three-dimensional plot, we can use the zlabel(‘string’) command in addition to the xla- 
bel(‘string’) and ylabel(‘string’). 

In a two-dimensional plot, we can set the limits of the x- and y- axes with the axis([xmin 
xmax ymin ymax]) command. Likewise, in a three-dimensional plot we can set the limits of all 
three axes with the axis([xmin xmax ymin ymax zmin zmax]) command. It must be placed 
after the plot(x,y) or plot3(x,y,z) commands, or on the same line without first executing the plot 
command. This must be done for each plot. The three-dimensional text(x,y,z,’string’) command 
will place string beginning at the co-ordinate (x, y, z) on the plot. 

For three-dimensional plots, grid on and box off are the default states. 

The mesh(x,y,z) command displays a three-dimensional plot. Another command, contour(Z,n), 
draws contour lines for n levels. We can also use the mesh(x,y,z) command with two vector argu- 
ments. These must be defined as length(x) = n and length(y) = m where 
[m, n] = size(Z). In this case, the vertices of the mesh lines are the triples { x(j), y(i), Z(i, j)} . 
We observe that x corresponds to the columns of Z, and y corresponds to the rows of Z. 

To produce a mesh plot of a function of two variables, say z = f(x, y), we must first generate the 
X and Y matrices which consist of repeated rows and columns over the range of the variables x 
and y. We can generate the matrices X and Y with the [X,Y]=meshgrid(x,y) function which 
creates the matrix X whose rows are copies of the vector x, and the matrix Y whose columns are 
copies of the vector y. 


Example 1.12 

The volume V of a right circular cone of radius r and height h is given by 

V = ^7tr 2 h (1.14) 

Plot the volume of the cone as r and h vary on the intervals 0 < r < 4 and 0 < h < 6 meters. 

Solution: 

The volume of the cone is a function of both the radius r and the height h, that is, V = f (r, h) 

The three-dimensional plot is created with the following MATLAB script where, as in the previ¬ 
ous example, in the second line we have used the dot multiplication, division, and exponentia¬ 
tion. As mentioned in the footnote of the previous page, this topic will be explained in Section 
1.8, Page 1-19. 
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[R,H]=meshgrid(0: 4, 0: 6); % Creates R and H matrices from vectors r and h 

V=(pi .* R A 2 .* H) ./ 3; mesh(R, H, V) 

xlabel('x-axis, radius r (meters) 1 ); ylabel('y-axis, altitude h (meters) 1 ); 
zlabel('z-axis, volume (cubic meters) 1 ); title('Volume of Right Circular Cone'); box on 

The three-dimensional plot of Figure 1.6, shows how the volume of the cone increases as the 
radius and height are increased. 


Volume of Right Circular Cone 



Figure 1.6. Volume of a right circular cone. 


This, and the plot of Figure 1.5, are rudimentary; MATLAB can generate very sophisticated and 
impressive three-dimensional plots. The MATLAB User’s manual contains more examples. 

1.7 Subplots 

MATLAB can display up to four windows of different plots on the Figure window using the com¬ 
mand subplot(m,n,p). This command divides the window into an m x n matrix of plotting areas 
and chooses the pth area to be active. No spaces or commas are required between the three inte¬ 
gers m, n, and p. The possible combinations are shown in Figure 1.7. 

We will illustrate the use of the subplot(m,n,p) command following the discussion on multiplica¬ 
tion, division and exponentiation that follows. 
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Figure 1.7. Possible subpot arrangements in MATLAB 


1.8 Multiplication, Division and Exponentiation 

MATLAB recognizes two types of multiplication, division, and exponentiation. These are the 
matrix multiplication, division, and exponentiation, and the element-by-element multiplication, 
division, and exponentiation. They are explained in the following paragraphs. 


In Section 1.2, the arrays [a b c ... ], such a those that contained the coefficients of polynomi¬ 
als, consisted of one row and multiple columns, and thus are called row vectors. If an array has 
one column and multiple rows, it is called a column vector. We recall that the elements of a row 
vector are separated by spaces. To distinguish between row and column vectors, the elements of a 
column vector must be separated by semicolons. An easier way to construct a column vector, is to 
write it first as a row vector, and then transpose it into a column vector. MATLAB uses the single 
quotation character (y) to transpose a vector. Thus, a column vector can be written either as 

b=[—1; 3; 6; 11] 

or as 

b=[—1 3 6 11]' 

MATLAB produces the same display with either format as shown below. 
b=[—1; 3; 6; 11] 
b - 

-1 

3 

6 

11 

b=[—1 3 6 11]' 

b = 

-1 

3 
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6 

11 


We will now define Matrix Multiplication and Element-by-Element multiplication. 
1. Matrix Multiplication (multiplication of row by column vectors) 

Let 

4 = [aj a 2 a 3 ... aj 

and 

B = [b! b 2 b 3 ... bj 


be two vectors. We observe that A is defined as a row vector whereas B is defined as a column 
vector, as indicated by the transpose operator (')• Here, multiplication of the row vector A by 
the column vector B , is performed with the matrix multiplication operator (*). Then, 

A*B = [ajbi + a 2 b 2 + a 3 b 3 + ... + a n b n ] = single value (B.15) 


For example, if 

A = [1 2 3 4 5] 

and 

B = [-2 6 -3 8 7]’ 

the matrix multiplication A*B produces the single value 68, that is, 


A*B = 1 x (-2) + 2 x 6 + 3 x (-3 ) + 4x8 + 5x7 = 68 
and this is verified with the MATLAB script 

A=[1 2 3 4 5]; E3=[ -2 6 -3 8 7]’; A*B % Observe transpose operator (‘) in B 

ans = 

68 

Now, let us suppose that both A and B are row vectors, and we attempt to perform a row-by- 
row multiplication with the following MATLAB statements. 

A=[1 2 3 4 5]; B=[-2 6 -3 8 7]; A*B % No transpose operator (‘) here 

When these statements are executed, MATLAB displays the following message: 

??? Error using ==> * 

Inner matrix dimensions must agree. 

Here, because we have used the matrix multiplication operator (*) in A*B, MATLAB expects 
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vector B to be a column vector, not a row vector. It recognizes that B is a row vector, and 
warns us that we cannot perform this multiplication using the matrix multiplication operator 
(*). Accordingly, we must perform this type of multiplication with a different operator. This 
operator is defined below. 

2. Element-by-Element Multiplication (multiplication of a row vector by another row vector) 


Let 

and 


C = [Cj c 2 c 3 ... c n ] 
D = [dj d 2 d 3 ... dj 


be two row vectors. Here, multiplication of the row vector C by the row vector D is per¬ 
formed with the dot multiplication operator (A). There is no space between the dot and the 
multiplication symbol. Thus, 


CAD = [cA c 2 d 2 c 3 d 3 ... c n d n ] 


(B.16) 


This product is another row vector with the same number of elements, as the elements of C 
and D. 

As an example, let 


and 


C = [1 2 3 4 5] 


D = [-2 6 -3 8 7] 


Dot multiplication of these two row vectors produce the following result. 


CAD = 1 x (-2) 2x6 3 x(-3) 4x 8 5x7 = -2 12 -9 32 35 
Check with MATLAB: 


C=[1 2 3 4 5]; 
D=[-2 6-3 8 71; 
C.*D 


% Vectors C and D must have 

% same number of elements 

% We observe that this is a dot multiplication 


ans = 

-2 12 -9 32 35 


Similarly, the division (/) and exponentiation () operators, are used for matrix division and 
exponentiation, whereas dot division (./) and dot exponentiation are used for element- 
by-element division and exponentiation, as illustrated with the examples above. 

We must remember that no space is allowed between the dot (.) and the multiplication (*), 
division ( /), and exponentiation ( A ) operators. 

Note: A dot (.) is never required with the plus (+) and minus (-) operators. 
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Example 1.13 

Write the MATLAB script that produces a simple plot for the waveform defined as 

y = f(t) = 3e 4t cos5t-2e 3t sin2t + —-— (1-17) 

t + 1 

in the 0 < t < 5 seconds interval. 

Solution: 

The MATLAB script for this example is as follows: 

t=0: 0.01: 5; % Define t-axis in 0.01 increments 

y=3 .* exp(-4 .* t) .* cos(5 .* t)-2 .* exp(-3 .* t) .* sin(2 .* t) + t , A 2 ./ (t+1); 
plot(t,y); grid; xlabel('t'); ylabel('y=f(t)'); title('Plot for Example 1.13') 

Figure 1.8 shows the plot for this example. 


Plot for Example 1.13 



Figure 1.8. Plot for Example 1.13 


Had we, in the example above, defined the time interval starting with a negative value equal to or 
less than -1, say as -3 < t < 3 , MATLAB would have displayed the following message: 

Warning: Divide by zero. 

This is because the last term (the rational fraction) of the given expression, is divided by zero when 
t = -1. To avoid division by zero, we use the special MATLAB function eps, which is a number 
approximately equal to 2.2 x 10 16 . It will be used with the next example. 

The command axis([xmin xmax ymin ymax]) scales the current plot to the values specified by 
the arguments xmin, xmax, ymin and ymax. There are no commas between these four argu¬ 
ments. This command must be placed after the plot command and must be repeated for each plot. 

The following example illustrates the use of the dot multiplication, division, and exponentiation, 
the eps number, the axis([xmin xmax ymin ymax]) command, and also MATLAB’s capability of 
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Multiplication, Division and Exponentiation 

displaying up to four windows of different plots. 


Example 1.14 
Plot the functions 


y = sin 2 x, z = cos 2 x, w = sin 2 x-cos 2 x, v = sin 2 x/cos 2 x 


(1.18) 


in the interval 0 < x < 271 using 100 data points. Use the subplot command to display these func¬ 
tions on four windows on the same graph. 

Solution: 


The MATLAB script to produce the four subplots is as follows: 


x=linspace(0, 2*pi,100); 
y=(sin(x) A 2); z=(cos(x) A 2); 
w=y .* z; 
v=y ./ (z+eps); 
subplot(221); 

plot(x,y); axis([0 2*pi 0 1]); 

title('y=(sinx) A 2'); 

subplot(222); 

plot(x,z); axis([0 2*pi 0 1]); 

title('z=(cosx) A 2'); 

subplot(223); 

plot(x,w); axis([0 2*pi 0 0.3]); 

title('w=(sinx) A 2*(cosx) A 2'); 

subplot(224); 

plot(x,v); axis([0 2*pi 0 400]); 
title('v=(sinx) A 2/(cosx) A 2'); 


% Interval with 100 data points 

% add eps to avoid division by zero 
% upper left of four subplots 

% upper right of four subplots 

% lower left of four subplots 

% lower right of four subplots 


These subplots are shown in Figure 1.9. 



Figure 1.9. Subplots for the functions of Example 1.14 
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The next example illustrates MATLAB’s capabilities with imaginary numbers. We will introduce 
the real(z) and imag(z) functions which display the real and imaginary parts of the complex quan¬ 
tity z = x + iy, the abs(z), and the angle(z) functions that compute the absolute value (magni¬ 
tude) and phase angle of the complex quantity z = x + iy = r-0. We will also use the 
polar(theta,r) function that produces a plot in polar coordinates, where r is the magnitude, theta 
is the angle in radians, and the round(n) function that rounds a number to its nearest integer. 


Example 1.15 

Consider the electric circuit of Figure 1.10. 


10 HP 


Figure 1.10. Electric circuit for Example 1.15 


With the given values of resistance, inductance, and capacitance, the impedance Z ab as a function 
of the radian frequency co can be computed from the following expression. 


= z = io +_ io 4 -i(io 6 /w) _ 

10 + j(0.1w-10 5 /w ) 


(1.19) 


a. Plot Re{Z} (the real part of the impedance Z) versus frequency co. 

b. Plot Im{Z} (the imaginary part of the impedance Z) versus frequency CO. 


c. Plot the impedance Z versus frequency co in polar coordinates. 

Solution: 


The MATLAB script below computes the real and imaginary parts of Z ab that is, for simplicity, 
denoted as z, and plots these as two separate graphs (parts a & b). It also produces a polar plot 
(part c). 

w=0: 1: 2000; % Define interval with one radian interval 

z=(10+(10 , A 4 —j -* 10 . A 6 ./ (w+eps))./ (10 + j .* (0.1 .* w-10. A 5./ (w+eps)))); 
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% 

% The first five statements (next two lines) compute and plot Re{z} 
real_part=real(z); plot(w,real_part); grid; 
xlabel('radian frequency w'); ylabel('Real part of Z'); 

% 

% The next five statements (next two lines) compute and plot lm{z} 
imag_part=imag(z); plot(w,imag_part); grid; 
xlabel('radian frequency w 1 ); ylabel('lmaginary part of Z 1 ); 

% The last six statements (next six lines) below produce the polar plot of z 
mag=abs(z);% Computes |Z| 

rndz=round(abs(z));% Rounds |Z| to read polar plot easier 
theta=angle(z);% Computes the phase angle of impedance Z 
polar(theta,rndz);% Angle is the first argument 
grid; 

ylabel('Polar Plot of Z 1 ); 

The real, imaginary, and polar plots are shown in Figures 1.11, 1.12, and 1.13 respectively. 



radian frequency w 

Figure 1.11. Plot for the real part of Z in Example 1.15 
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radian frequency w 

Figure 1.12. Plot for the imaginary part of Z in Example 1.15 



Figure 1.13. Polar plot of Z in Example 1.15 


Example 1.15 clearly illustrates how powerful, fast, accurate, and flexible MATLAB is. 

1.9 Script and Function Files 

MATLAB recognizes two types of files: script files and function files. Both types are referred to as 
m-files since both require the .m extension. 

A script file consists of two or more built-in functions such as those we have discussed thus far. 
Thus, the script for each of the examples we discussed earlier, make up a script file. Generally, a 
script file is one which was generated and saved as an m-file with an editor such as the MATLAB’s 
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Script and Function Files 

Editor/Debugger. 

A function file is a user-defined function using MATLAB. We use function files for repetitive 
tasks. The first line of a function file must contain the word function, followed by the output argu¬ 
ment, the equal sign ( = ), and the input argument enclosed in parentheses. The function name 
and file name must be the same, but the file name must have the extension .m. For example, the 
function file consisting of the two lines below 

function y = myfunction(x) 
y=x , A 3 + cos(3 .* x) 

is a function file and must be saved. To save it, from the File menu of the command window, we 
choose New and click on M-File. This takes us to the Editor Window where we type these two 
lines and we save it as myfunction.m. 

We will use the following MATFAB functions with the next example. 

The function fzero(f,x) tries to find a zero of a function of one variable, where f is a string con¬ 
taining the name of a real-valued function of a single real variable. MATFAB searches for a value 
near a point where the function f changes sign, and returns that value, or returns NaN if the 
search fails. 

Important: We must remember that we use roots(p) to find the roots of polynomials only, such as 
those in Examples 1.1 and 1.2. 

fplot(fcn,lims) - plots the function specified by the string fen between the x-axis limits specified 

by lims = [xmin xmax]. Using lims = [xmin xmax ymin ymax] also controls the y-axis limits. 
The string fen must be the name of an m-file function or a string with variable x. 

NaN (Not-a-Number) is not a function; it is MATFAB’s response to an undefined expression 
such as 0/0, oo/ oo ; or inability to produce a result as described on the next paragraph. We can 
avoid division by zero using the eps number, which we mentioned earlier. 


Example 1.16 

Find the zeros, maxima and minima of the function 

f (x) = -\\-10 (1.20) 

(x-0.1) +0.01 (x-1.2) z + 0.04 


in the interval -1.5 <x< 1.5 
Solution: 

We first plot this function to observe the approximate zeros, maxima, and minima using the fol¬ 
lowing script: 
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x=-1.5: 0.01: 1.5; 

y=1./ ((x-0.1 ). A 2 + 0.01) -1./ ((x-1.2). A 2 + 0.04) -10; 
plot(x,y); grid 

The plot is shown in Figure 1.14. 



Figure 1.14. Plot for Example 1.16 using the plot command 

The roots (zeros) of this function appear to be in the neighborhood of x = -0.2 and x = 0.3. The 
maximum occurs at approximately x = 0.1 where, approximately, y max = 90, and the minimum 
occurs at approximately x = 1.2 where, approximately, y min = -34. 

Next, we define and save f(x) as the funczeroOl .m function m-file with the following script: 

function y=funczero01 (x) 

% Finding the zeros of the function shown below 
y=1/((x-0.1) A 2+0.01)-1/((x-1.2) A 2+0.04)-10; 

To save this file, from the File drop menu on the Command Window, we choose New, and when 
the Editor Window appears, we type the script above and we save it as funczeroOl. MATLAB 
appends the extension .m to it. 

Now, we can use the fplot(fcn,lims) command to plot f(x) as follows: 

fplot('funczeroOT, [-1.5 1.5]); grid 

This plot is shown in Figure 1.15. As expected, this plot is identical to the plot of Figure 1.14 which 
was obtained with the plot(x,y) command as shown in Figure 1.14. 
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Script and Function Files 



Figure 1.15. Plot for Example 1.16 using the fplot command 

We will use the fzero(f,x) function to compute the roots of f(x) in Equation (1.20) more pre¬ 
cisely. The MATLAB script below will accomplish this. 

xl = fzero('funczero01-0.2); 
x2= fzeroffunczeroOl0.3); 

fprintf('The roots (zeros) of this function are r1= %3.4f', xl); 
fprintff and r2= %3.4f \n', x2) 

MATLAB displays the following: 

The roots (zeros) of this function are rl= -0.1919 and r2= 0.3788 
The earlier MATLAB versions included the function fmin(f,x1 ,x2) and with this function we 
could compute both a minimum of some function f(x) or a maximum of f(x) since a maximum 
of f(x) is equal to a minimum of-f(x). This can be visualized by flipping the plot of a function 
f(x) upside-down. This function is no longer used in MATLAB and thus we will compute the 
maxima and minima from the derivative of the given function. 

Lrom elementary calculus, we recall that the maxima or minima of a function y = f(x) can be 
found by setting the first derivative of a function equal to zero and solving for the independent 
variable x. Lor this example we use the diff(x) function which produces the approximate deriva¬ 
tive of a function. Thus, we use the following MATLAB script: 

syms x ymin zmin; ymin=1/((x-0.1) A 2+0.01)-1/((x-1.2) A 2+0.04)-10;... 
zmin=diff(ymin) 

zmin = 

-1/ ( (x-l/10) / '2 + l/100) /s 2* (2*x-l/5) +1/ ( (x-6/5) A 2 + l/25) ^2* (2*x-12/5) 
When the command 
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solve(zmin) 

is executed, MATLAB displays a very long expression which when copied at the command prompt 
and executed, produces the following: 

ans = 

0.6585 + 0.3437i 
ans = 

0.6585 - 0.3437i 
ans = 

1.2012 

The real value 1.2012 above is the value of x at which the function y has its minimum value as 
we observe also in the plot of Figure 1.15. 

To find the value of y corresponding to this value of x, we substitute it into f(x), that is, 
x=1.2012; ymin=1 / ((x-0.1) A 2 + 0.01) -1 / ((x-1.2) A 2 + 0.04) -10 
ymin = -34.1812 

We can find the maximum value from -f (x) whose plot is produced with the script 

x=-1.5:0.01:1.5; ymax=-1 ./((x-0.1) A 2+0.01)+1 ./((x-1.2) A 2+0.04)+10; plot(x,ymax); grid 

and the plot is shown in Figure 1.16. 



Figure 1.16. Plot of -f(x) for Example 1.16 

Next we compute the first derivative of-f(x) and we solve for x to find the value where the max¬ 
imum of ymax occurs. This is accomplished with the MATLAB script below, 
syms x ymax zmax; ymax=-(1/((x-0.1) A 2+0.01)-1/((x-1.2) A 2+0.04)-10); zmax=diff(ymax) 
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zmax 


Display Formats 


1/((x-1/10) A 2+l/100) A 2*(2*x-l/5)-1/((x-6/5) A 2+l/25)^2*(2*x-12/5) 

solve(zmax) 

When the command 

solve(zmax) 

is executed, MATLAB displays a very long expression which when copied at the command 
prompt and executed, produces the following: 

ans = 

0.6585 + 0.3437i 
ans = 

0.6585 - 0.3437i 

ans = 

1.2012 
ans - 

0.0999 

From the values above we choose x = 0.0999 which is consistent with the plots of Figures 1.15 
and 1.16. Accordingly, we execute the following script to obtain the value of ymin. 

x=0.0999; % Using this value find the corresponding value of ymax 

ymax=1 /((x-0.1) A 2 + 0.01) -1 /((x-1.2) A 2 + 0.04) -10 

ymax = 89.2000 


1.10 Display Formats 

MATLAB displays the results on the screen in integer format without decimals if the result is an 
integer number, or in short floating point format with four decimals if it a fractional number. The 
format displayed has nothing to do with the accuracy in the computations. MATLAB performs all 
computations with accuracy up to 16 decimal places. 

The output format can changed with the format command. The available formats can be displayed 
with the help format command as follows: 

help format 

FORMAT Set output format. 

All computations in MATLAB are done in double precision. 

FORMAT may be used to switch between different output display 
formats as follows: 
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FORMAT 

FORMAT 

FORMAT 

FORMAT 

FORMAT 

FORMAT 

FORMAT 

FORMAT 

FORMAT 


FORMAT 

FORMAT 


SHORT 
LONG 
SHORT E 
LONG E 
SHORT G 

LONG G 

HEX 


BANK 

RAT 


Default. Same as SHORT. 

Scaled fixed point format with 5 digits. 
Scaled fixed point format with 15 digits. 
Floating point format with 5 digits. 
Floating point format with 15 digits. 

Best of fixed or floating point 
format with 5 digits. 

Best of fixed or floating point format 
with 15 digits. 

Hexadecimal format. 

The symbols +, - and blank are printed 
for positive, negative and zero elements. 
Imaginary parts are ignored. 

Fixed format for dollars and cents. 
Approximation by ratio of small integers. 


Spacing: 

FORMAT COMPACT Suppress extra line-feeds. 

FORMAT LOOSE Puts the extra line-feeds back in. 


Some examples with different format displays age given below. 

format short 33.3335 Four decimal digits (default) 

format long 33.33333333333334 16 digits 

format short e 3.3333e+01 Four decimal digits plus exponent 

format short g 33.333 Better of format short or format short e 

format bank 33.33 two decimal digits 

format + only + or - or zero are printed 

format rat 100/3 rational approximation 


1-32 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 





Summary 

1.11 Summary 

• We can get help with MATLAB topics by typing help followed by any topic available. For 
example, the command help matlab\iofun will display input/output information, and help mat- 
lab graphics will display help on graphics. 

• The MATLAB Demos menu displays MATLAB’s capabilities. To access it, we type demo and 
we see the different topics. Whenever we want to return to the command window, we click on 
the Close button. 

• We type quit or exit when we are done and want to leave MATLAB. 

• We use the clear command if we want to clear all previous values, variables, and equations 
without exiting. 

• The clc command clears the screen but MATLAB still remembers all values, variables and 
equations which we have already used. 

• All text after the % (percent) symbol is interpreted by MATLAB as a comment line and thus it 
is ignored during the execution of a program. A comment can be typed on the same line as the 
function or command or as a separate line. 

• For computations involving complex numbers we can use either i, or j to denote the imagi¬ 
nary part of the complex number. 

• In MATLAB, a polynomial is expressed as a row vector of the form [a n a n _ , a 2 aj a 0 ]. The 
elements aj of this vector are the coefficients of the polynomial in descending order. We must 
include terms whose coefficients are zero. 

• We find the roots of any polynomial with the roots(p) function where p is a row vector con¬ 
taining the polynomial coefficients in descending order. 

• We can compute the coefficients of a polynomial from a given set of roots with the poly(r) 
function where r is a row vector containing the roots. 

• The polyval(p,x) function evaluates a polynomial p(x) at some specified value of the inde¬ 
pendent variable x. 

• The conv(a,b) function multiplies the polynomials a and b. 

• The [q,r]=deconv(c,d) function divides polynomial c by polynomial d and displays the quo¬ 
tient q and remainder r. 

• The polyder(p) function produces the coefficients of the derivative of a polynomial p. 

• We can write MATLAB statements in one line if we separate them by commas or semicolons. 
Commas will display the results whereas semicolons will suppress the display. 
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• Rational Polynomials are those which can be expressed in ratio form, that is, as 

b n x n + b n _ t x n ^ 1 + b n _ 2 x n 2 + ... + b t x + b 0 
a m x m + a m _ 1 x m + a m _ 2 x m + ... + ajx + a 0 

where some of the terms in the numerator and/or denominator may be zero. Normally, we 
express the numerator and denominator of a rational function as a combination of linear and 
quadratic factors. 

• We use the MATLAB command plot(x,y) to make two-dimensional plots. This command 
plots y versus x where x is the horizontal axis (abscissa), and y is the vertical axis (ordinate). 

• If a statement, or a row vector is too long to fit in one line, it can be continued to the next line 
by typing three or more periods, then pressing <enter> to start a new line, and continue to 
enter data. 

• We can make a two-dimensional plot more presentable with the commands grid, box, 
title(‘string’), xlabel(‘string’), and ylabel(‘string’). For a three-dimensional plot, we can also 
use the zlabel(‘string’) command. 

• The semilogx(x,y) command is similar to the plot(x,y) command, except that the x-axis is 
represented as a log scale, and the y-axis as a linear scale. Likewise, the semilogy(x,y) com¬ 
mand is similar to the plot(x,y) command, except that the y-axis is represented as a log scale, 
and the x-axis as a linear scale. The loglog(x,y) command uses logarithmic scales for both 
axes. 

• The function log(x) in MATLAB is the natural logarithm, whereas the common logarithm is 
expressed as Iog10(x). Likewise, the logarithm to the base 2 is expressed as log2(x). 

• The ratio of any two values of the same quantity, typically power, is normally expressed in deci¬ 
bels (dB) and by definition, 

dB = lOlog 

• The command gtext(‘string’) switches to the current Figure Window, and displays a cross-hair 
which can be moved around with the mouse. The command text(x,y,’string’) is similar to 
gtext(‘string’); it places a label on a plot in some specific location specified by x and y, and 
string is the label which we want to place at that location. 

• The command linspace(first_value, last_value, number_of_values) specifies the number of 
data points but not the increments between data points. An alternate command uses the colon 
notation and has the format x=first: increment: last. This format specifies the increments 
between points but not the number of data points. 


| p out | 

P“ 


Dr v \ = Num(x) = 
( ’ Den(x) 
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• MATLAB has no default color; it starts with blue and cycles through seven colors. Also, there 
is no default marker; no markers are drawn unless they are selected. The default line is the 
solid line. 

• The plot3(x,y,z) command plots a line in 3-space through the points whose coordinates are 
the elements of x, y, and z, where x, y, and z are three vectors of the same length. 

• In a two-dimensional plot, we can set the limits of the x- and y-axes with the axis([xmin 
xmax ymin ymax]) command. Likewise, in a three-dimensional plot we can set the limits of 
all three axes with the axis([xmin xmax ymin ymax zmin zmax]) command. It must be 
placed after the plot(x,y) or plot3(x,y,z) commands, or on the same line without first execut¬ 
ing the plot command. This must be done for each plot. The three-dimensional 
text(x,y,z,’string’) command will place string beginning at the co-ordinate (x, y, z) on the 
plot. 

• The mesh(x,y,z) command displays a three-dimensional plot. Another command, con- 
tour(Z,n), draws contour lines for n levels. We can also use the mesh(x,y,z) command with 
two vector arguments. These must be defined as length(x) = n and length(y) = m 
where [m, n] = size(Z). In this case, the vertices of the mesh lines are the triples 
{x(j), y(i), Z(i, j)} . We observe that x corresponds to the columns of Z, and y corresponds to 
the rows of Z. To produce a mesh plot of a function of two variables, say z = f(x, y), we must 
first generate the X and Y matrices which consist of repeated rows and columns over the 
range of the variables x and y. We can generate the matrices X and Y with the [X,Y]=mesh- 
grid(x,y) function which creates the matrix X whose rows are copies of the vector x, and the 
matrix Y whose columns are copies of the vector y. 

• MATLAB can display up to four windows of different plots on the Figure window using the 
command subplot(m,n,p). This command divides the window into an m x n matrix of plotting 
areas and chooses the pth area to be active. 

• With MATLAB, matrix multiplication (multiplication of row by column vectors) is performed 
with the matrix multiplication operator (*), whereas element-by-element multiplication is 
performed with the dot multiplication operator (.*). Similarly, the division (/) and exponentia¬ 
tion ( A ) operators, are used for matrix division and exponentiation, whereas dot division (./) 
and dot exponentiation (. A ) are used for element-by-element division and exponentiation. 

• To avoid division by zero, we use the special MATLAB function eps, which is a number 
approximately equal to 2.2 x 10 16 . 

• The command axis([xmin xmax ymin ymax]) scales the current plot to the values specified 
by the arguments xmin, xmax, ymin and ymax. There are no commas between these four 
arguments. This command must be placed after the plot command and must be repeated for 
each plot. 
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• The real(z) and imag(z) functions display the real and imaginary parts of the complex quantity 
z = x + iy, and the abs(z), and the angle(z) functions compute the absolute value (magnitude) 
and phase angle of the complex quantity z = x + iy = r-6. The polar(theta,r) function pro¬ 
duces a plot in polar coordinates, where r is the magnitude, and theta is the angle in radians. 

• MATLAB recognizes two types of files: script files and function files. Both types are referred to 
as m-files. A script file consists of two or more built-in functions. Generally, a script file is one 
which was generated and saved as an m-file with an editor such as the MATLAB’s Editor/ 
Debugger. A function file is a user-defined function using MATLAB. We use function files for 
repetitive tasks. The first line of a function file must contain the word function, followed by the 
output argument, the equal sign ( = ), and the input argument enclosed in parentheses. The 
function name and file name must be the same, but the file name must have the extension .m. 

• The MATLAB fmin(f,x1,x2) function minimizes a function of one variable. It attempts to 
return a value of x where f(x) is minimum in the interval x, < x < x 2 . The string f contains 
the name of the function to be minimized. 

• The MATLAB fplot(fcn,lims) command plots the function specified by the string fen between 
the x-axis limits specified by lims = [xmin xmax]. Using lims = [xmin xmax ymin ymax] also 
controls the y -axis limits. The string fen must be the name of an m-file function or a string 
with variable x. 

• The MATLAB fprintffformat,array) command used above displays and prints both text and 
arrays. It uses specifiers to indicate where and in which format the values would be displayed 
and printed. Thus, if %f is used, the values will be displayed and printed in fixed decimal for¬ 
mat, and if %e is used, the values will be displayed and printed in scientific notation format. 
With these commands only the real part of each parameter is processed. 

• MATLAB displays the results on the screen in integer format without decimals if the result is 
an integer number, or in short floating point format with four decimals if it a fractional number. 
The format displayed has nothing to do with the accuracy in the computations. MATLAB per¬ 
forms all computations with accuracy up to 16 decimal places. 
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Exercises 

1.12 Exercises 

1. Use MATLAB to compute the roots of the following polynomials: 

a. p(x) = x 3 + 8x 2 + lOx + 4 

b. p(y) = y 5 + 7y 4 + 19y 3 + 25y 2 + 16y + 4 

2. Use MATLAB to derive the polynomials having the following roots: 

a. -6.5708 - 0.7146 + j0.3132 -0.7146-j0.3132 

b. Two roots at x = -2.000 and three roots at x = -3.000 

3. Use MATLAB to evaluate the polynomials below at the specified values. 

a. p(x) = x 3 + 8x 2 + lOx + 4 at x = 1.25 

b. p(y) = y 5 + 7y 4 + 19y 3 + 25y 2 + 16y + 4 at y = -3.75 

4. In the electric circuit below, the applied voltage V s was kept constant and the voltage V c 
across the capacitor was measured and recorded at several frequencies as shown on the table 
below. 



Capacitor voltage versus radian frequency 

to 

500 

600 

700 

800 

900 

1000 

< 

o 

88.9 

98.5 

103.0 

104.9 

105.3 

104.8 

(0 

1100 

1200 

1300 

1400 

1500 

1600 

V c 

103.8 

102.4 

100.7 

98.9 

96.5 

94.9 


Plot V c (in dB scale) versus co (in common log scale) and label the axes appropriately. 
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Chapter 1 Introduction to MATLAB 
1.13 Solutions to End-of-Chapter Exercises 

Dear Reader: 

The remaining pages on this chapter contain the solutions to the exercises. 

You must, for your benefit, make an honest effort to find the solutions to the exercises without first 
looking at the solutions that follow. It is recommended that first you go through and work out 
those you feel that you know. For the exercises that you are uncertain, review this chapter and try 
again. Refer to the solutions as a last resort and rework those exercises at a later date. 

You should follow this practice with the rest of the exercises of this book. 
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Solutions to End-of-Chapter Exercises 

1 . 

a. 

Px=[1 8 10 4]; roots(Px) 

ans = 

-6.5708 

-0.7146 + 0.3132i 
-0.7146 - 0.3132i 

b. 

Py=[1 7 19 25 16 4]; roots(Py) 

ans = 

- 2.0000 

- 2.0000 

- 1.0000 

-1.0000 + O.OOOOi 
-1.0000 - O.OOOOi 


2 . 


rl =[-6.5708 -0.7146+0.3132j -0.7146-0.3132j]; poly_r1=poly(r1) 

poly_rl = 1.0000 8.0000 9.9997 4.0000 

p(x) = x 3 + 8x 2 + lOx 4- 4 
b. 

r2=[—2 -2 -3 -3 -3]; poly_r2=poly(r2) 

poly_r2 = 

1 13 67 171 216 108 

p(z) = Z 5 + 13z 4 + 67 z 3 + 171z 2 + 216z + 108 
3. 

a. 

Pv=[1 8 10 4]; value=polyval(Pv, 1.25) 

value = 30.9531 

b. 

Pw=[1 7 19 25 16 4]; value=polyval(Pw,-3.75) 

value = -63.6904 
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4. 

w=[5 67891011 12 13 14 15 16]*100; 

Vc=[88.9 98.5 103 104.9 105.3 104.8 103.8 102.4 100.7 98.9 96.5 94.9]; 
dB=20*log10(Vc); semilogx(w,dB); grid; title('Magnitude of Vc vs. w 1 );... 
xlabel('w in rads/sec 1 ); ylabel('|Vc| in volts') 


Magnitude of Vc vs. w 



1-40 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 





























Chapter 2 


Root Approximations 


T his chapter is an introduction to Newton’s and bisection methods for approximating roots 
of linear and non-linear equations. Several examples are presented to illustrate practical 
solutions using MATLAB and Excel spreadsheets. 

2.1 Newton’s Method for Root Approximation 

Newton’s (or Newton-Raphson) method can be used to approximate the roots of any linear or 
non-linear equation of any degree. This is an iterative (repetitive procedure) method and it is 
derived with the aid of Figure 2.1. 



y 


Figure 2.1. Newton’s method for approximating real roots of a function 


We assume that the slope is neither zero nor infinite. Then, the slope (first derivative) at x = Xj 
is 



(2.1) 


y-f(Xi) = fXXjKx-Xj) 


The slope crosses the x - axis at x = x 2 and y = 0. Since this point [x 2 , f(x 2 )] = (x 2 , 0) lies on 
the slope line, it satisfies (2.1). By substitution, 


0 - f( x i) = f'(x 1 )(x 2 -x 1 ) 



( 2 . 2 ) 


and in general, 


f(x n ) 

f'(x n ) 


(2.3) 
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Chapter 2 Root Approximations 


Example 2.1 

Use Newton’s method to approximate the positive root of 

f(x) = x 2 - 5 (2.4) 

to four decimal places. 

Solution: 


As a first step, we plot the curve of (2.4) to find out where it crosses the x-axis. This can be 
done easily with a simple plot using MATLAB or a spreadsheet. We start with MATLAB and will 
discuss the steps for using a spreadsheet afterwards. 

We will now introduce some new MATLAB functions and review some which are discussed in 
Chapter 1. 

input(‘string’): It displays the text string, and waits for an input from the user. We must enclose 
the text in single quotation marks. 

We recall that the polyder(p) function displays the row vector whose values are the coefficients 
of the first derivative of the polynomial p. The polyval(p,x) function evaluates the polynomial p 
at some value x. Therefore, we can compute the next iteration for approximating a root with 
Newton’s method using these functions. Knowing the polynomial p and the first approximation 
x 0 , we can use the following script for the next approximation x 2 . 

q=polyder(p) 

x1=x0-polyval(p,x0)/polyval(q,x0) 

We’ve used the fprintf command in Chapter 1; we will use it many more times. Therefore, let us 
review it again. 

The following description was extracted from the help fprintf function. 

It formats the data in the real part of matrix A (and in any additional matrix arguments), under control 
of the specified format string, and writes it to the file associated with file identifier fid and contains C lan¬ 
guage conversion specifications. These specifications involve the character %, optional flags, optional 
width and precision fields, optional subtype specifier, and conversion characters d, i, o, u, x, X, f, e, E, 
g, G, c, and s. See the Language Reference Guide or a C manual for complete details. The special for¬ 
mats \n,\r,\t,\b>\f can be used to produce linefeed, carriage return, tab, backspace, and formfeed charac¬ 
ters respectively. Use \\ to produce a backslash character and %% to produce the percent character. 

To apply Newton’s method, we must start with a reasonable approximation of the root value. In 
all cases, this can best be done by plotting f(x) versus x with the familiar statements below. The 
following two lines of script will display the graph of the given equation in the interval -4 < x < 4 . 

x=linspace(-4, 4,100); % Specifies 100 values between -4 and 4 

y=x , A 2 - 5; plot(x,y); grid % The dot exponentiation is a must 
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We chose this interval because the given equation asks for the square root of 5; we expect this 
value to be a value between 2 and 3 . For other functions, where the interval may not be so obvi¬ 
ous, we can choose a larger interval, observe the x - axis crossings, and then redefine the inter¬ 
val. The plot is shown in Figure 2.2. 



Figure 2.2. Plot for the curve of Example 2.1 


As expected, the curve shows one crossing between x = 2 and x = 3 , so we take x 0 = 2 as our 
first approximation, and we compute the next value Xj as 


x i = x o 


f( x o) 

f '( x o) 


2- ( 2 r~ 5 = 2-bl) = 225 

2(2) 4 


The second approximation yields 


X 2 


X 1 


f ( x i) = 2 25 - ( 2 - 25 ) 2 - 5 
f'( Xl ) ' 2(2.25) 


We will use the following MATLAB script to verify (2.5) and (2.6). 

% Approximation of a root of a polynomial function p(x) 

% Do not forget to enclose the coefficients in brackets [ ] 
p=input('Enter coefficients of p(x) in descending order:'); 
xO=input('Enter starting value:'); 

q=polyder(p); % Calculates the derivative of p(x) 

x1=x0-polyval(p,x0)/polyval(q,x0); 

fprintf('\n'); % Inserts a blank line 

% 

% The next function displays the value of xi in decimal format as indicated 

% by the specifier %9.6f, i.e., with 9 digits where 6 of these digits 
% are to the right of the decimal point such as xxx.xxxxxx, and 


(2.5) 


( 2 . 6 ) 
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Chapter 2 Root Approximations 


% \n prints a blank line before printing xl 

fprintf('The next approximation is: %9.6f \ri, xl) 

fprintf('\ri); % Inserts another blank line 

% 

fprintf('Rerun the program using this value as your next.... 

approximation \ri); 

The following lines show MATLAB’s inquiries and our responses (inputs) for the first two 
approximations. 

Enter coefficients of P(x) in descending order: 

[1 0-5] 

Enter starting value: 2 

The next approximation is: 2.250000 

Rerun the program using this value as your 

next approximation 

Enter polynomial coefficients in 

descending order: [1 0-5] 

Enter starting value: 2.25 

The next approximation is: 2.236111 

We observe that this approximation is in close agreement with (2.6). 


In Chapter 1 we discussed script files and function files. We recall that a function file is a user- 
defined function using MATLAB. We use function files for repetitive tasks. The first line of a 
function file must contain the word function followed by the output argument, the equal sign (=), 
and the input argument enclosed in parentheses. The function name and file name must be the 
same but the file name must have the extension .m. For example, the function file consisting of 
the two lines below 

function y = myfunction(x) 
y=x , A 3 + cos(3 .* x) 

is a function file and must be saved as myfunction.m 
We will use the while end loop, whose general form is 

while expression 
commands ... 

end 

where the commands ... in the second line are executed as long as all elements in expression of the 
first line are true. 

We will also be using the following commands: 
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disp(x): Displays the array x without printing the array name. If x is a string, the text is displayed. 
For example, if v = 12, disp(v) displays 12, and disp(‘volts’) displays volts. 

sprintf(format,A): Formats the data in the real part of matrix A under control of the specified 
format string. For example, 

sprintf('%d',round(pi)) 

ans = 

3 

where the format script %d specifies an integer. Likewise, 

sprintf('%4.3f',pi) 

ans = 

3.142 

where the format script %4.3f specifies a fixed format of 4 digits where 3 of these digits are allo¬ 
cated to the fractional part. 


Example 2.2 

Approximate one real root of the non-linear equation 

f(x) = x 2 + 4x + 3 + sinx-xcosx (2.7) 

to four decimal places using Newton’s method. 

Solution: 

As a first step, we sketch the curve to find out where the curve crosses the x - axis. We generate 
the plot with the script below. 

x=linspace(-pi, pi, 100); y=x , A 2 + 4.*x + 3 + sin(x) - x .* cos(x); plot(x,y); grid 
The plot is shown in Figure 2.3. 

The plot shows that one real root is approximately at x = -1, so we will use this value as our first 
approximation. 

Next, we generate the function funcnewtOI and we save it as an m-file. To save it, from the File 
menu of the command window, we choose New and click on M-F ile. This takes us to the Editor 
Window where we type the following three lines and we save it as funcnewtOI.m. 

function y=funcnewt01(x) 

% Approximating roots with Newton's method 
y=x , A 2 + 4.*x + 3 + sin(x) - x .* cos(x); 
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Figure 2.3. Plot for the equation of Example 2 .2 


We also need the first derivative of y; This is y' = 2x + 4 + xsinx 

The computation of the derivative for this example was a simple task; however, we can let MAT - 
LAB do the differentiation, just as a check, and to introduce the diff(s) function. This function 
performs differentiation of symbolic expressions. The syms function is used to define one or 
more symbolic expressions. 

syms x 

y = x A 2+4*x+3+sin(x)-x*cos(x); % Dot operations are not necessary with 

% symbolic expressions, but correct 
% answer will be displayed if they are used, 
yl =diff(y) % Find the derivative of y 

yi = 

2*x+4+x*sin(x) 

Now, we generate the function funcnewt02, and we save it as m-file. To save it, from the File 
menu of the command window, we choose New and click on M-F He. This takes us to the Editor 
Window where we type these two lines and we save it as funcnewt02.m. 

function y=funcnewt02(x) 

% Finding roots by Newton's method 

% The following is the first derivative of the function defined as funcnewt02 
y=2 .* x + 4 + x .* sin(x); 

Our script for finding the next approximation with Newton’s method follows. 

x = input('Enter starting value:'); 
fx = funcnewtOI(x); 
fprimex = funcnewt02(x); 
xnext = x-fx/fprimex; 
x = xnext; 
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fx = funcnewtOI(x); 
fprimex = funcnewt02(x); 

disp(sprintf('First approximation is x = %9.6f \n', x)) 
while input('Next approximation? (<enter>=no,1=yes)'); 
xnext=x-fx/fprimex; 
x=xnext; 

fx=funcnewt01(x); 

fprimex=funcnewt02(x); 

disp(sprintf('Next approximation is x = %9.6f \n', x)) 
end; 

disp(sprintf('%9.6f \n', x)) 

MATLAB produces the following result with -1 as a starting value. 

Enter starting value: -1 

First approximation is: -0.894010 

Next approximation? (<enter>=no,l=yes)1 

-0.895225 

Next approximation? (<enter>=no, l=yes) <enter> 

We can also use the fzero(f,x) function. It was introduced in Chapter 1. This function tries to 
find a zero of a function of one variable. The string f contains the name of a real-valued function 
of a single real variable. As we recall, MATLAB searches for a value near a point where the func¬ 
tion f changes sign and returns that value, or returns NaN if the search fails. 


2.2 Approximations with Spreadsheets 

In this section, we will go through several examples to illustrate the procedure of using a spread¬ 
sheet such as Excel to approximate the real roots of linear and non-linear equations. 

We recall that there is a standard procedure for finding the roots of a cubic equation; it is 
included here for convenience. 

A cubic equation of the form 

y 3 + py 2 + qy + r = 0 (2.8) 

can be reduced to the simpler form 

x 3 + ax + b = 0 (2.9) 

where 


* We will illustrate our examples with Excel, although others such as Lotus 1—2—3, and Quattro can also be used. Hence¬ 
forth, all spreadsheet commands and formulas that we will be using, will be those of Excel. 
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x = y + E a = ^(3q-p 2 ) b = ^(2p 3 - 9pq + 27r) (2.10) 

For the solution it is convenient to let 



Then, the values of x for which the cubic equation of (2.11) is equal to zero are 

A + B , A - B /—= A + B A - B r-x , 0 

x 2 = -—V-3 *3 = ~— - — V- 3 (2.12) 

and r are real, then (2.13) 

> 0 one root will be real and the other two complex conjugates 

< 0 the roots will be real and unequal 

= 0 there will be three real roots with at least two equal 

While MATLAB handles complex numbers very well, spreadsheets do not. Therefore, unless we 
know that the roots are all real, we should not use a spreadsheet to find the roots of a cubic equa¬ 
tion by substitution in the above formulas. However, we can use a spreadsheet to find the real 
root since in any cubic equation there is at least one real root. For real roots, we can use a spread¬ 
sheet to define a range of x values with small increments and compute the corresponding values 
of y = f(x). Then, we can plot y versus x to observe the values of x that make f(x) = 0. This 
procedure is illustrated with the examples that follow. 

Note: In our subsequent discussion we will omit the word cell and the key <enter>. Thus B3, 
Cl 1, and so on will be understood to be cell B3, cell Cl 1, and so on. Also, after an entry has been 
made, it will be understood that the <enter> key was pressed. 


Xj = A + B 


If the coefficients p, q, 


Example 2.3 

Compute the roots of the polynomial 


using Excel. 


y = f(x) = x 3 - 7x 2 + 16x - 12 


(2.14) 
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Solution: 

We start with a blank worksheet. In an Excel worksheet, a selected cell is surrounded by a heavy 
border. We select a cell by moving the thick hollow white cross pointer to the desired cell and we 
click. For this example, we first select A1 and we type x. We observe that after pressing the 
<enter> key, the next cell moves downwards to A2; this becomes the next selected cell. We type 
0.00 in A2. We observe that this value is displayed just as 0, that is, without decimals. Next, we 
type 0.05 in A3. We observe that this number is displayed exactly as it was typed. 

We will enter more values in column A, and to make all values look uniform, we click on letter A 
on top of column A. We observe that the entire column is now highlighted, that is, the back¬ 
ground on the monitor has changed from white to black. Next, from the Tools drop menu of the 
Menu bar, we choose Options and we click on the Edit tab. We click on the Fixed Decimal check 
box to place a check mark and we choose 2 as the number of decimal places. We repeat these 
steps for Column B and we choose 3 decimal places. Then, all numbers that we will type in Col¬ 
umn A will be fixed numbers with two decimal places, and the numbers in Column B will be fixed 
with three decimal places. 

To continue, we select A2, we click and holding the mouse left button down, we drag the mouse 
down to A3 so that both these two cells are highlighted; then we release the mouse button. 
When properly done, A2 will have a white background but A3 will have a black background. We 
will now use the AutoFill feature to fill-in the other values of x in Column A. We will use values 
in 0.05 increments up to 5.00. Column A now contains 100 values of x from 0.00 to 5.00 in incre¬ 
ments of 0.05. 

Next, we select Bl, and we type f(x). In B2, we type the equation formula with the = sign in front 
of it, that is, we type 

= A2 A 3-7*A2 A 2 + 16*A2-2 

where A2 represents the first value of x = 0.00. We observe that B2 displays the value -12.000. 
This is the value of f(x) when x = 0.00 Next, we want to copy this formula to the range 
B3:B102 (the colon : means B3 through B102). With B2 still selected, we click on Edit on the 
main taskbar, and we click on Copy. We select the range B3:B102 with the mouse, we release the 
mouse button, and we observe that this range is now highlighted. We click on Edit, then on Paste 
and we observe that this range is now filled with the values of f(x). Alternately, we can use the 
Copy and Paste icons of the taskbar. 


* To use this feature, we highlight cells A2 and A3. We observe that on the lower right comer of A3, there is a small black 
square; this is called the fill handle. If it does not appear on the spreadsheet, we can make it visible by performing the 
sequential steps Tools > Options, select the Edit tab, and place a check mark on the Drag and Drop setting. Next, we point 
the mouse to the fill handle and we observe that the mouse pointer appears as a small cross. We click, hold down the mouse 
button, we drag it down to A102, and we release the mouse button. We observe that, as we drag the fill handle, a pop—up 
note shows the cell entry for the last value in the range. 
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To plot f(x) versus x, we click on the Chart Wizard icon of the Standard Toolbar, and on the 
Chart type column we click on XY (Scatter). From the displayed charts, we choose the one on top 
of the right side (the smooth curves without connection points). Then, we click on Next, Next, 
Next, and Finish. A chart similar to the one on Figure 2.4 appears. 


X 

f(x) 


i -1-1-1-1-1-n— 



f(x) 


0.00 

-12.000 



0.05 

-11.217 



0.10 

-10.469 


20 
15 - 

10 - 
5 




/ 


0.15 

-9.754 



/ 

0.20 

-9.072 




0.25 

-8.422 



0.30 

-7.803 


-5 - 

^-— 


0.35 

-7.215 


-10 - 
-15 - 




0.40 

-6.656 





0.45 

-6.126 


0 1 2 3 4 5 6 


0.50 

-5.625 



0.55 

-5.151 

1 1 1 1 1 1 II 


Figure 2.4. Plot of the equation of Example 2.3. 


We will modify this plot to make it more presentable, and to see more precisely the x-axis 
crossing(s), that is, the roots of f(x). This is done with the following steps: 

1. We click on the Series 1 box to select it, and we delete it by pressing the Delete key. 

2. We click anywhere inside the graph box. Then, we see it enclosed in six black square handles. 
From the View menu, we click on Toolbars, and we place a check mark on Chart. The Chart 
menu appears in two places, on the main taskbar and below it in a box where next to it is 
another small box with the hand icon. Note: The Chart menu appears on the main taskbar and 
on the box below it, only when the graph box is selected, that is, when it is enclosed in black 
square handles. From the Chart menu box (below the main taskbar), we select Value (X) axis, 
and we click on the small box next to it (the box with the hand icon). Then, on the Format axis 
menu, we click on the Scale tab and we make the following entries: 

Minimum: 0.0 
Maximum: 5.0 
Major unit: 1.0 
Minor unit: 0.5 

We click on the Number tab, we select Number from the Category column, and we type 0 in the 
Decimal places box. We click on the Font tab, we select any font, Regular style, Size 9. We click 
on the Patterns tab to select it, and we click on Low on the Tick mark labels (lower right box). 
We click on OK to return to the graph. 

3. From the Chart menu box we select Value (Y) axis and we click on the small box next to it (the 
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box with the hand icon). On the Format axis menu, we click on the Scale tab, and we make the 
following entries: 

Minimum: -1.0 
Maximum: 1.0 
Major unit: 0.25 
Minor unit: 0.05 

We click on the Number tab, we select Number from the Category column, and we select 2 in 
the Decimal places box. We click on the Font tab, select any font, Regular style, Size 9. We click 
on the Patterns tab, and we click on Outside on the Major tick mark type (upper right box). We 
click on OK to return to the graph. 

4. We click on Chart on the main taskbar, and on the Chart Options. We click on Gridlines, we 
place check marks on Major gridlines of both Value (X) axis and Value (Y) axis. Then, we click 
on the Titles tab and we make the following entries: 

Chart title: f(x) = the given equation (or whatever we wish) 

Value (X) axis: x (or whatever we wish) 

Value (Y) axis: y=f(x) (or whatever we wish) 

5. Now, we will change the background of the plot area from gray to white. From the Chart 
menu box below the main task bar, we select Plot Area and we observe that the gray back¬ 
ground of the plot area is surrounded by black square handles. We click on the box next to it 
(the box with the hand icon), and on the Area side of the Patterns tab, we click on the white 
square which is immediately below the gray box. The plot area on the chart now appears on 
white background. 

6. To make the line of the curve f(x) thicker, we click at any point near it and we observe that 
several black square handles appear along the curve. Series 1 appears on the Chart menu box. 
We click on the small box next to it, and on the Patterns tab. From the Weight selections we 
select the first of the thick lines. 

7. Finally, to change Chart Area square comers to round, we select Chart Area from the Chart 
menu, and on the Patterns tab we place a check mark on the Round comers box. 

The plot now resembles the one shown in Figure 2.5 where we have shown partial lists of x and 

f(x). The given polynomial has two roots at x = 2, and the third root is x = 3 . 

We will follow the same procedure for generating the graphs of the other examples which follow; 

therefore, it is highly recommended that this file is saved with any name, say poly01.xls where.xls 

is the default extension for file names saved in Excel. 
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f(x) 
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Figure 2.5. Modified plot of the equation of Example 2.3. 


Example 2.4 

Find a real root of the polynomial 

y = f(x) = 3 x 5 -2x 3 + 6x-8 (2.15) 

using Excel. 

Solution: 

To save lots of unnecessary work, we invoke (open) the spreadsheet of the previous example, that 
is, poly01.xls (or any other file name that was assigned to it), and save it with another name such 
as poly02.xls. This is done by first opening the file poly01.xls, and from the File drop down menu, 
we choose the Save as option; then, we save it as poly02.xls, or any other name. When this is 
done, the spreadsheet of the previous example still exists as poly01.xls. Next, we perform the fol¬ 
lowing steps: 

1. For this example, the highest power of the polynomial is 5 (odd number), and since we know 
that complex roots occur in conjugate pairs, we expect that this polynomial will have at least 
one real root. Since we do not know where a real root is in the x-axis interval, we arbitrarily 


2-12 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 































































Approximations with Spreadsheets 


choose the interval -10 < x < 10. Then, we enter -10 and -9 in A2 and A3 respectively. Using 
the AutoFill feature, we fill-in the range A4:A22, and we have the interval from -10 to 10 in 
increments of 1. We must now delete all rows starting with 23 and downward. We do this by 
highlighting the range A23:B102, and we press the Delete key. We observe that the chart has 
changed shape to conform to the new data. 

Now we select B2 where we enter the formula for the given equation, i.e., 
=3*A2 A 5-2*A2 A 3+6*A2-8 

We copy this formula to B3:B22. Columns A and B now contain values of x and f(x) respec¬ 
tively, and the plot shows that the curve crosses the x-axis somewhere between x = 1 and 
x = 2. 

A part of the table is shown in Figure 2.6. Columns A (values of x), and B (values of f(x)), 
reveal some useful information. 


X 

f(x) 

-10.00 

-298068.000 

-9.00 

-175751.000 

0.00 

-8.000 

1.00 

-1.000 

2.00 

84.000 

9.00 

175735.000 

10.00 

298052.000 


Sign Change 


Figure 2.6. Partial table for Example 2.4 


This table shows that f(x) changes sign somewhere in the interval from x = 1 and x = 2. 
Let us then redefine our interval of the x values as 1 < x < 2 in increments of 0.05, to get bet¬ 
ter approximations. When this is done A1 contains 1.00, A2 contains 1.05, and so on. Our 
spreadsheet now shows that there is a sign change from B3 to B4, and thus we expect that a 
real root exists between x = 1.05 and x = 1.10 . To obtain a good approximation of the real 
root in that interval, we perform Steps 2 through 4 below. 

2. On the View menu, we click on Toolbars and place a check mark on Chart. We select the graph 
box by clicking inside it, and we observe the square handles surrounding it. The Chart menu 
on the main taskbar and the Chart menu box below it, are now displayed. From the Chart 
menu box (below the main taskbar) we select Value (X) axis, and we click on the small box 
next to it (the box with the hand). Next, on the Format axis menu, we click on the Scale tab 
and make the following entries: 

Minimum: 1.0 
Maximum: 1.1 
Major unit: 0.02 
Minor unit: 0.01 
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3. From the Chart menu we select Value (Y) axis, and we click on the small box next to it. Then, 
on the Format axis menu, we click on the Scale tab and make the following entries: 

Minimum: -1.0 
Maximum: 1.0 
Major unit: 0.5 
Minor unit: 0.1 

4. We click on the Titles tab and make the following entries: 

Chart title: f(x) = the given equation (or whatever we wish) 

Value (X) axis: x (or whatever we wish) 

Value (Y) axis: y=f(x) (or whatever we wish) 

Our spreadsheet now should look like the one in Figure 2.7 and we see that one real root is 
approximately 1.06. 


X 

f(x) 













f(x) = 

3x 5 - 2x 3 -t 

■ 6x - 8 



1.00 

-1.000 
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1.95 
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1.20 

3.209 


2.00 

84.000 


f(x) 

= - 

-0.007 atx 

= 1.06 






1 1 




Figure 2.7. Graph for Example 2.4 


Since no other roots are indicated on the plot, we suspect that the others are complex conjugates. 
We confirm this with MATLAB as follows: 

p = [ 3 0 -2 0 6 -8]; roots_p=roots(p) 
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roots_p = 
-1.1415 
-1.1415 
0.6113 
0.6113 
1.0604 


+ 0.8212i 

- 0.8212i 
+ 0.9476i 

- 0.947 6i 


Example 2.5 

Compute the real roots of the trigonometric function 

y = f(x) = cos2x+sin2x + x-1 (2.16) 

using Excel. 

Solution: 

We invoke (open) the spreadsheet of one of the last two examples, that is, poly01.xls or poly02.xls, 
and save it with another name, such as poly03.xls. 

Since we do not know where real roots (if any) are in the x-axis interval, we arbitrarily choose the 
interval -1 < x < 6. Then, we enter -1.00 and -0.90 in A2 and A3 respectively, Using the Auto¬ 
Fill feature, we fill-in the range A4:A72 and thus we have the interval from -1 to 6 in increments 
of 0.10. Next, we select B2 and we enter the formula for the given equation, i.e., 

=COS(2*A2)+SIN(2*A2)+A2-1 

and we copy this formula to B3:B62. 

There is a root at x = 0 ; this is found by substitution of zero into the given equation. We observe 
that Columns A and B contain the following sign changes (only a part of the table is shown): 


Sign Change 
Sign Change 

We observe two sign changes. Therefore, we expect two more real roots, one in the 
1.20 < x < 1.30 interval and the other in the 2.20 < x < 2.30 interval. If we redefine the x - axis 
range as 1 to 2.5, we will find that the other two roots are approximately x = 1.30 and x = 2.24. 

Approximate values of these roots can also be observed on the plot of Figure 2.8 where the curve 
crosses the x - axis. 


X 

f(x) 

1.20 

0.138 

1.30 

-0.041 

2.20 

-0.059 

2.30 

0.194 
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f(x) 
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Figure 2.8. Graph for Example 2.5 


We can obtain more accurate approximations using Excel’s Goal Seek feature. We use Goal Seek 
when we know the desired result of a single formula, but we do not know the input value which 
satisfies that result. Thus, if we have the function y = f(x), we can use Goal Seek to set the 
dependent variable y to the desired value (goal) and from it, find the value of the independent 
variable x which satisfies that goal. In the last three examples our goal was to find the values of x 
for which y = f(x) = 0. 

To illustrate the Goal Seek feature, we will use it to find better approximations for the non-zero 
roots of Example 2.5. We do this with the following steps: 

1. We copy range A24:B24 (or A25:B25) to two blank cells, say J1 and Kl, so that J1 contains 
1.20 and Kl contains 0.138 (or 1.30 and -0.041 if range A25:B25 was copied). We increase the 
accuracy of Columns J and K to 5 decimal places by clicking on Format, Cells, Numbers tab. 

2. From the Tools drop menu, we click on Goal Seek, and when the Goal Seek dialog box appears, 
we make the following entries: 

Set cell: Kl 
To value: 0 

By changing cell: J1 

3. When this is done properly, we will observe the changes in J1 and Kl. These indicate that for 
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X = 1.27647, y = f(x) = 0.00002. 

4. We repeat the above steps for the next root near x = 2.20, and we verify that for 
x = 2.22515, y = f(x) = 0.00020. 

Another method of using the Goal Seek feature, is with a chart such as those we’ve created for the 

last three examples. We will illustrate the procedure with the chart of Example 2.5. 

1. We point the mouse at the curve where it intersects the x-axis, near the x = 1.30 point. A 
square box appears and displays Series 1, (1.30, -0.041). We observe that other points are also 
displayed as the mouse is moved at different points near the curve. 

2. We click anywhere near the curve, and we observe that five handles (black square boxes) are 
displayed along different points on the curve. Next, we click on the handle near the x = 1.30 
point, and when the cross symbol appears, we drag it towards the x-axis to change its value. 
The Goal Seek dialog box then appears where the Set cell shows B24. Then, in the To value box 
we enter 0, in the By changing cell we enter A24 and we click on OK. We observe now that A24 
displays 1.28 and B24 displays 0.000. 


For repetitive tasks, such as finding the roots of polynomials, it is prudent to construct a template 
(model spreadsheet) with the appropriate formulas and then enter the coefficients of the polyno¬ 
mial to find its real roots . This is illustrated with the next example. 


Example 2.6 

Construct a template (model spreadsheet), with Excel, which uses Newton’s method to approxi¬ 
mate a real root of any polynomial with real coefficients up to the seventh power; then, use it to 
compute a root of the polynomial 

y = f(x) = x 7 - 6x 6 + 5x 5 - 4x 4 + 3x 3 - 2x 2 + x-15 (2.17) 

given that one real root lies in the 4 < x < 6 interval. 

Solution: 

1. We begin with a blank spreadsheet and we make the entries shown in Figure 2.9. 


* There exists a numerical procedure, known as Bairstow’s method, that we can use to find the complex roots of a polyno¬ 
mial with real coefficients. We will not discuss this method here; it can be found in advanced numerical analysis text books. 
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Figure 2.9. Model spreadsheet for finding real roots of polynomials. 


We save the spreadsheet of Figure 2.9 with a name, say template.xls. Then, we save it with a dif¬ 
ferent name, say Example_2_6.xls, and in B16 we type the formula 

=A16-($A$7*A16 A 7+$B$7*A16 A 6+$C$7*A16 A 5+$D$7*A16 A 4 
+$E$7*A16 A 3+$F$7*A16 A 2+$G$7*A16 A 1 +$H$7)/ 
($B$12*A16 A 6+$C$12*A16 A 5+$D$12*A16 A 4+$E$12*A16 A 3 
+$F$12*A16 A 2+$G$12*A16 A 1+$H$12) 

The use of the dollar sign ($) is explained in Paragraph 4 below. 

The formula in B16 of Figure 2.10, is the familiar Newton’s formula which also appears in Row 
14. We observe that B16 now displays #DIV/0! (this is a warning that some value is being 
divided by zero), but this will change once we enter the polynomial coefficients, and the coeffi¬ 
cients of the first derivative. 

2. Since we are told that one real root is between 4 and 6, we take the average 5 and we enter it in 
A16. This value is our first (initial) approximation. We also enter the polynomial coefficients, 
and the coefficients of the first derivative in Rows 7 and 12 respectively. 

3. Next, we copy B16 to C16:F16 and the spreadsheet now appears as shown in the spreadsheet 
of Figure 2.10. We observe that there is no change in the values of E16 and F16; therefore, we 
terminate the approximation steps there. 


2-18 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 









































The Bisection Method for Root Approximation 



A 

B 

C 1 

1 D 1 



1 G 

H 

1 

Spreadsheet for finding approximations of the real roots of polynomials 


2 

up the 7th power by Newton's Method. 





3 






4 

Powers of x and corresponding coefficients of given polynomial p(x) 

5 

Enter coefficients of p(x) in Row 7 





6 

X 7 

x 6 

x 5 

x 4 

x 3 

x 2 

X 

Constant 

7 

1 

-6 

5 

-4 

3 

-2 

i 

-15 

8 









9 

Coefficients of the derivative p'(x) 





10 

Enter coefficients of p'(x) in Row 12 





11 


x 6 

x 5 

X 4 

X 3 

X 2 

X 

Constant 

12 


7 

-36 

25 

-16 

9 

-4 

1 

13 









14 

Approximations: x n+1 = x n - 

P(x n )/p-(x„ 

) 




15 

Initial (x 0 ] 

1st fa) 

2nd (x 2 ) 

3rd (x 3 ) 

4th (x 4 ) 

5th (x 5 ) 

6th (x 6 ) 

7th (x 7 ) 

16 

5.0 

5.20409 

5.16507 

5.163194 

5.163190 

5.163190 




Figure 2.10. Spreadsheet for Example 2.6. 


4. All cells in the formula of B16, except A16, have dollar signs ($) in front of the column letter, 
and in front of the row number. These cells are said to be absolute. The value of an absolute 
cell does not change when it is copied from one position to another. A cell that is not absolute 
is said to be relative cell. Thus, B16 is a relative cell, and $B$16 is an absolute cell. The con¬ 
tents of a relative cell changes when it is copied from one location to another. We can easily 
convert a relative cell to absolute or vice versa, by first placing the cursor in front, at the end, 
or between the letters and numbers of the cell, then, we press the function key F4- In this 
example, we made all cells, except A16, absolute so that the formula of B16 can be copied to 
C16, D16 and so on, without changing its value. The relative cell A16, when copied to the 
next column, changes to B16, when copied to the next column to the right, changes to C16, 
and so on. 

We can now use this template with any other polynomial by just entering the coefficients of the 
new polynomial in row 7 and the coefficients of its derivative in Row 12; then, we observe the 
successive approximations in Row 16. 


2.3 The Bisection Method for Root Approximation 

The Bisection (or interval halving ) method is an algorithm for locating the real roots of a function. 


* This is a step—by—step problem-solving procedure, especially an established, recursive computational procedure for solving 
a problem in a finite number of steps. 
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The objective is to find two values of x, say Xj and x 2 , so that f(xj) and f(x 2 ) have opposite 
signs, that is, either f(xj) > 0 and f(x 2 ) < 0, or f(x,) < 0 and f(x 2 ) > 0. If any of these two condi¬ 
tions is satisfied, we can compute the midpoint x m of the interval x, < x < x 2 with 


x m 


Xj +x 2 
2 


(2.18) 


Knowing x m , we can find f(x m ). Then, the following decisions are made: 

1. If f(x m ) and f(x,) have the same sign, their product will be positive, that is, f(x m ) • f(x,) > 0 . 
This indicates that x m and x, are on the left side of the x-axis crossing as shown in Figure 2.11. 
In this case, we replace Xj with x m . 


ffx^ and f(x m ) are 
both positive and thus 
their product is positive 



fix,) and f(x m ) are 
both negative and thus 
their product is positive 



Figure 2.11. Sketches to illustrate the bisection method when f(x,) and f(x m ) have same sign 


2. If f(x m ) and f(x 1 ) have opposite signs, their product will be negative, that is, f(x m ) • f(xj) < 0 . 
This indicates that x m and x 2 are on the right side of the x-axis crossing as in Figure 2.12. In 
this case, we replace x 2 with x m . 


f(xj) and f(x m ) have 
opposite signs and thus 
their product is negative 



f(xj) and f(x m ) have 
opposite signs and thus 
their product is negative 



Figure 2.12. Sketches to illustrate the bisection method when f(xj) and f(x m ) have opposite signs 


After making the appropriate substitution, the above process is repeated until the root we are 
seeking has a specified tolerance. To terminate the iterations, we either: 

a. specify a number of iterations 

b. specify a tolerance on the error of f(x) 
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We will illustrate the Bisection Method with examples using both MATLAB and Excel. 


Example 2.7 

Use the Bisection Method with MATLAB to approximate one of the roots of 

y = f(x) = 3x 5 —2x 3 + 6x—8 (2.19) 

by 

a. by specifying 16 iterations, and using a for end loop MATLAB program 

b. by specifying 0.00001 tolerance for f(x), and using a while end loop MATLAB program 

Solution: 

This is the same polynomial as in Example 2.4. 

a. The for end loop allows a group of functions to be repeated a fixed and predetermined num¬ 
ber of times. The syntax is: 

for x = array 
commands... 

end 

Before we write the program script, we must define a function assigned to the given polyno¬ 
mial and save it as a function m-file. We will define this function as funcbisectOl and will save 
it as funcbisectOl.m. 

function y= funcbisectOl (x); 
y = 3 .* x A 5 - 2 .* x A 3 + 6 .* x - 8; 

% We must not forget to type the semicolon at the end of the line above; 

% otherwise our script will fill the screen with values of y 

On the script below, the statement for k = 1:16 says for k = 1, k = 2, ..., k = 16, evaluate all 
commands down to the end command. After the k = 16 iteration, the loop ends and any 
commands after the end are computed and displayed as commanded. 

Let us also review the meaning of the fprintf('%9.6f %13.6f \n', xm,fm) line. Here, %9.6f and 
%13.6f are referred to as format specifiers or format scripts; the first specifies that the value of 
xm must be expressed in decimal format also called fixed point format, with a total of 9 digits, 6 
of which will be to the right of the decimal point. Likewise, fm must be expressed in decimal 
format with a total of 13 digits, 6 of which will be to the right of the decimal point. Some other 
specifiers are %e for scientific format, %S for string format, and %d for integer format. Lor 
more information, we can type help fprintf. The special format \n specifies a linefeed, that is, it 
prints everything specified up to that point and starts a new line. We will discuss other special 
formats as they appear in subsequent examples. 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


2-21 






Chapter 2 Root Approximations 


The script for the first part of Example 2.7 is given below. 


xl =1; x2=2; % We know this interval from Example 2.4, Figure 2.6 

dispC xm frri) % xm is the average of xl and x2, fm is f(xm) 

disp('.') % insert line under xm and fm 

for k= 1:16; 


fl =funcbisect01 (xl); f2=funcbisect01 (x2); 
xm=(x1+x2) / 2; fm=funcbisect01(xm); 

fprintf('%9.6f %13.6f \n', xm,fm) % Prints xm and fm on same line; 
if (f1*fm<0) 
x2=xm; 
else 
x1=xm; 
end 
end 

When this program is executed, MATLAB displays the following: 
xm fm 


1.500000 

1.250000 

1.125000 

1.062500 

1.031250 

1.046875 

1.054688 

1.058594 

1.060547 

1.059570 

1.060059 

1.060303 

1.060425 

1.060364 

1.060394 

1.060410 


17.031250 

4.749023 

1.308441 

0.038318 

-0.506944 

-0.241184 

-0.103195 

-0.032885 

0.002604 

-0.015168 

-0.006289 

-0.001844 

0.000380 

-0.000732 

-0.000176 

0.000102 


We observe that the values are displayed with 6 decimal places as we specified, but for the 
integer part unnecessary leading zeros are not displayed. 

b. The while end loop evaluates a group of commands an indefinite number of times. The syntax 
is: 


while expression 

commands... 
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end 

The commands between while and end are executed as long as all elements in expression are 
true. The script should be written so that eventually a false condition is reached and the loop 
then terminates. 

There is no need to create another function m-file; we will use the same as in part a. Now we 
type and execute the following while end loop program. 

x1=1; x2=2; tol=0.00001; 

dispf xm fm'); dispf.') 

while (abs(x1-x2)>2*tol); 

f1=funcbisect01(x1); f2=funcbisect01(x2); xm=(x1+x2)/2; 
fm=funcbisect01 (xm); 
fprintf('%9.6f %13.6f \n\ xm.fm); 
if (f1*fm<0); 

x2=xm; 

else 

x1=xm; 

end 

end 

When this program is executed, MATLAB displays the following: 
xm fm 


1.500000 

1.250000 

1.125000 

1.062500 

1.031250 

1.046875 

1.054688 

1.058594 

1.060547 

1.059570 

1.060059 

1.060303 

1.060425 

1.060364 

1.060394 

1.060410 

1.060402 

1.060406 

1.060404 


17.031250 

4.749023 

1.308441 

0.038318 

- 0.506944 

- 0.241184 

- 0.103195 

- 0.032885 

0.002604 

- 0.015168 

- 0.006289 

- 0.001844 

0.000380 

- 0.000732 

- 0.000176 

0.000102 

- 0.000037 

0.000032 

- 0.000003 
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Next, we will use an Excel spreadsheet to construct a template that approximates a real root of a 
function with the bisection method. This requires repeated use of the IF function which has the 
following syntax. 

=IF(logical_test,valueJf_true,value_if_false) 

where 

logical_test: any value or expression that can be evaluated to true or false. 
value_if_true: the value that is returned if logical_test is true. 

If logical_test is true and value_if_true is omitted, true is returned. Value_if_true can be another 
formula. 

value_if_false is the value that is returned if logical_test is false, If logical_test is false and 
value_if_false is omitted, false is returned. Value_if_false can be another formula. 

These statements may be clarified with the following examples. 

=IF(C11 >=1500,A15, B15):If the value in Cll is greater than or equal to 1500, use the value in 
A15; otherwise use the value in B15. 

=IF(D22<E22, 800, 1200):If the value in D22 is less than the value of E22, assign the number 
800; otherwise assign the number 1200. 

=IF(M8<>N17, K7*12, L8/24):If the value in M8 is not equal to the value in N1 7, use the value in 
K7 multiplied by 12; otherwise use the value in L8 divided by 24. 


Example 2.8 

Use the bisection method with an Excel spreadsheet to approximate the value of */5 within 
0.00001 accuracy. 

Solution: 

Finding the square root of 5 is equivalent to finding the roots of x 2 - 5 = 0. We expect the posi¬ 
tive root to be in the 2 < x < 3 interval so we assign Xj = 2 and x 2 = 3 . The average of these 
values is x m = 2.5 . We will create a template as we did in Example 2.6 so we can use it with any 
polynomial equation. We start with a blank spreadsheet and we make the entries in rows 1 
through 12 as shown in Figure 2.13. 

Now, we make the following entries in rows 13 and 14. 

A13: 2 
B13: 3 

Cl 3: =(A13+B13)/2 


2-24 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 






The Bisection Method for Root Approximation 



A 

B 

c 1 

1 D 1 

m 

rr 

G 

H 

1 

Spreadsheet for finding approximations of the real roots 



2 

of polynomials using the Bisection method 





3 








4 

Equation: 

y = f(x) = x : 

! - 5 = 0 






5 








6 

Powers of: 

x and corresponding coefficients of given polynomial f(x) 



7 

Enter coefficients of f(x) in Row 9 






8 

x 7 

x 6 

x 5 

x 4 

x 3 

x 2 

X 

Constant 

9 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

1.00000 

0 

-5 

10 









11 

Xi 

x 2 

x m 

f(Xi) 

f(x m ) 

f(Xi)f(X m ) 



12 



(x 1+ x 2 )/2 







Figure 2.13. Partial spreadsheet for Example 2 .8 


D13: =$A$9*A13 A 7+$B$9*A13 A 6+$C$9*A13 A 5+$D$9*A13 A 4 
+$E$9*A13 A 3+$F$9*A13 A 2+$G$9*A13 A 1 +$H$9*A13 A 0 
El 3: =$A$9*C13 A 7+$B$9*C13 A 6+$C$9*C13 A 5+$D$9*C13 A 4 
+$E$9*C13 A 3+$F$9*C13 A 2+$G$9*C13 A 1 +$H$9*C13 A 0 
FI 3: =D13*E13 
A14: =IF(A14=A13, C13, B13) 

B14: =IF(A14=A13, C13, B13) 

We copy C13 into 04 and we verify that 04: =(A14+B14)/2 

Next, we highlight D13:F13 and on the Edit menu we click on Copy. We place the cursor on D14 
and from the Edit menu we click on Paste. We verify that the numbers on D14:F14 are as shown 
on the spreadsheet of Figure 2.14. Finally, we highlight A14:F14, from the Edit menu we click on 
Copy, we place the cursor on A15, and holding the mouse left button, we highlight the range 
A15:A30. Then, from the Edit menu, we click on Paste and we observe the values in A15:F30. 

The square root of 5 accurate to six decimal places is shown on C30 in the spreadsheet of Figure 
2.14. 
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A 

B 

C 1 

1 D 1 

m 

1 r 

G 

H 

1 

Spreadsheet for finding approximations of the real roots 



2 

of polynomials using the Bisection method 





3 








4 

Equation: 

y = f(x) = x 

-5 = 0 






5 








6 

Powers of x and corresponding coefficients of given polynomial f(x) 



7 

Enter coefficients of f(x) in Row 9 






8 

x 7 

x 6 

X 5 

x 4 

x 3 

x 2 

X 

Constant 

9 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

1.00000 

0 

-5 

10 









11 

x 1 

*2 

X m 

f(Xi) 

f(x m ) 

f(Xi)f(x m ) 



12 



(Xi+x 2 )/2 






13 

2.00000 

3.00000 

2.50000 

-1.00000 

1.25000 

-1.25000 



14 

2.00000 

2.50000 

2.25000 

-1.00000 

0.06250 

-0.06250 



15 

2.00000 

2.25000 

2.12500 

-1.00000 

-0.48438 

0.48438 



16 

2.12500 

2.25000 

2.18750 

-0.48438 

-0.21484 

0.10406 



17 

2.18750 

2.25000 

2.21875 

-0.21484 

-0.07715 

0.01657 



18 

2.21875 

2.25000 

2.23438 

-0.07715 

-0.00757 

0.00058 



19 

2.23438 

2.25000 

2.24219 

-0.00757 

0.02740 

-0.00021 



20 

2.23438 

2.24219 

2.23828 

-0.00757 

0.00990 

-0.00007 



21 

2.23438 

2.23828 

2.23633 

-0.00757 

0.00116 

-0.00001 



22 

2.23438 

2.23633 

2.23535 

-0.00757 

-0.00320 

0.00002 



23 

2.23535 

2.23633 

2.23584 

-0.00320 

-0.00102 

0.00000 



24 

2.23584 

2.23633 

2.23608 

-0.00102 

0.00007 

0.00000 



25 

2.23584 

2.23608 

2.23596 

-0.00102 

-0.00047 

0.00000 



26 

2.23596 

2.23608 

2.23602 

-0.00047 

-0.00020 

0.00000 



27 

2.23602 

2.23608 

2.23605 

-0.00020 

-0.00006 

0.00000 



28 

2.23605 

2.23608 

2.23607 

-0.00006 

0.00000 

0.00000 



29 

2.23605 

2.23607 

2.23606 

-0.00006 

-0.00003 

0.00000 



30 

2.23606 

2.23607 

2.23606 

-0.00003 

-0.00001 

0.00000 




Figure 2.14. Entire spreadsheet for Example 2.8 
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Summary 


2.4 Summary 

• Newton’s (or Newton-Raphson) method can be used to approximate the roots of any linear or 
non-linear equation of any degree. It uses the formula 



To apply Newton’s method, we must begin with a reasonable approximation of the root value. 
In all cases, this can best be done by plotting f(x) versus x. 

• We can use a spreadsheet to approximate the real roots of linear and non-linear equations but 
to approximate all roots (real and complex conjugates) it is advisable to use MATLAB. 

• The MATLAB the while end loop evaluates a group of statements an indefinite number of 
times and thus can be effectively used for root approximation. 

• For approximating real roots we can use Excel’s Goal Seek feature. We use Goal Seek when 
we know the desired result of a single formula, but we do not know the input value which sat¬ 
isfies that result. Thus, if we have the function y = f(x), we can use Goal Seek to set the 
dependent variable y to the desired value (goal) and from it, find the value of the indepen¬ 
dent variable x which satisfies that goal. 

• For repetitive tasks, such as finding the roots of polynomials, it is prudent to construct a tem¬ 
plate (model spreadsheet) with the appropriate formulas and then enter the coefficients of the 
polynomial to find its real roots. 

• The Bisection (or interval halving) method is an algorithm for locating the real roots of a 
function. The objective is to find two values of x, say Xj and x 2 , so that f(xj) and f(x 2 ) have 
opposite signs, that is, either f(x,) > 0 and f(x 2 ) < 0, or f(x,) < 0 and f(x 2 ) > 0 . If any of these 
two conditions is satisfied, we can compute the midpoint x m of the interval Xj < x < x 2 with 

x^ 
m 2 

• We can use the Bisection Method with MATLAB to approximate one of the roots by specify¬ 
ing a number of iterations using a for end or by specifying a tolerance using a while end loop 
program. 

• We can use an Excel spreadsheet to construct a template that approximates a real root of a 
function with the bisection method. This requires repeated use of the IF function which has 
the =IF(logical_test,valueJf_true,value_if_false) 
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2.5 Exercises 

1. Use MATLAB to sketch the graph y = f(x) for each of the following functions, and verify 
from the graph that f(a) and f(b), where a and b defined below, have opposite signs. Then, 
use Newton’s method to estimate the root of f(x) = 0 that lies between a and b. 

a. fj(x) = x 4 + x-3 a=l b = 2 

b. f 2 (x) = J2x + 1 - Vx + 4 a = 2 b = 4 
Hint: Start with x 0 = (a + b)/2 

2. Repeat Exercise 1 above using the Bisection method. 

3. Repeat Example 2.5 using MATLAB. 

Hint: Use the procedure of Example 2.2 
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Solutions to End-of-Chapter Exercises 


2.6 Solutions to End-of-Chapter Exercises 
1 . 


x=-2:0.05:2; f1x=x.M+x-3; plot(x,f1x); grid 



From the plot above we see that the positive root lies between x = 1 and x = 1.25 so we 
choose a = 1 and b = 1.25 so we take x 0 = 1.1 as our first approximation. We compute 
the next value xj as 


Xl = x 0 -M = !.!-(!•! ) 4+ l'l-3 = U _(zM36) = L 
1 ° f'(x 0 ) 4(1.1) 3 + 1 6.324 


169 


4(1-1) 

The second approximation yields 

f( ^- = 1.169 - C- 169 ) + 1.169-3 _ 1169 _ 0.0365 _ U64 


4(1.169) + 1 


7.39 


Check with MATLAB: 

pa=[1 0 0 1 -3]; roots(pa) 

ans = 


-1.4526 

0.1443 + 1.324H 
0.1443 - 1.3241i 
1.1640 
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x=-5:0.05:5; f2x=sqrt(2.*x+1)-sqrt(x+4); plot(x,f2x); grid 

Warning: Imaginary parts of complex X and/or Y arguments ignored. 



From the plot above we see that the positive root is very close to x = 3 and so we take 
x 0 = 3 as our first approximation. To compute the next value Xj we first need to find the 
first derivative of f 2 (x). We rewrite it as 


f 2 (x) = J2x + 1 - Jx + 4 = (2x + 1) 1/2 - (x + 4) IA 


Then, 


£ ■ f 2 (x) = ^ • (2x + 1) -1/2 • 2 - ^ • (x + 4) -1/2 • 1 = 1 


and 


1 2x + 1 2jx + 4 


f(x 0 ) = 3 J2 x 3 + 1 - 73T4 = 3_0__ 

f '(x 0 ) 1/77-1/(277) 1/(277) 


Thus, the real root is exactly x = 3. We also observe that since f(x 0 ) = 77-77 = 0, 
there was no need to find the first derivative f '(x 0 ). 

Check with MATLAB: 

syms x; f2x=sqrt(2.*x+1)-sqrt(x+4); solve(f2x) 

ans = 


3 
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2 . 

a. We will use the for end loop MATLAB program and specify 12 iterations. Before we write 
the program script, we must define a function assigned to the given polynomial and save it 
as a function m-file. We will define this function as exercise2 and will save it as 
exercise2.m 

function y= exercise2(x); 
y = x , A 4 +x - 3; 

After saving this file as exercise2.m, we execute the following program: 


xl =1; x2=2; % xl =a and x2=b 

dispf xm fm 1 ) % xm is the average of xl and x2, fm is f(xm) 

dispf'.') % insert line under xm and fm 

for k= 1:12; 


fl =exercise2(x1); f2=exercise2(x2); 
xm=(x1+x2) / 2; fm=exercise2(xm); 

fprintf('%9.6f %13.6f \n', xm,fm)% Prints xm and fm on same line; 
if (f1*fm<0) 
x2=xm; 


x1=xm; 

end 

end 

MATLAB displays the following: 
xm fm 


1.500000 

1.250000 

1.125000 

1.187500 

1.156250 

1.171875 

1.164063 

1.160156 

1.162109 

1.163086 

1.163574 

1.163818 


3.562500 

0.691406 

-0.273193 

0.176041 

-0.056411 

0.057803 

0.000200 

-0.028229 

-0.014045 

-0.006930 

-0.003367 

-0.001584 


b. We will use the while end loop MATLAB program and specify a tolerance of 0.00001. 

We need to redefine the function m-file because the function in part (b) is not the same as 
in part a. 
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function y= exercise2(x); 
y = sqrt(2.*x+1)-sqrt(x+4); 

After saving this file as exercise2.m, we execute the following program: 

xl =2.1; x2=4.3; tol=0.00001; % If we specify xl =a=2 and x2=b=4, the program 

% will not display any values because xm=(x1+x2)/2 = 3 = answer 

dispf xm fm'); dispf.') 

while (abs(x1-x2)>2*tol); 

f1=exercise2(x1); f2=exercise2(x2); xm=(x1+x2)/2; 
fm=exercise2(xm); 
fprintf('%9.6f %13.6f \n', xm,fm); 
if (f1*fm<0); 
x2=xm; 
else 
x1=xm; 
end 
end 

When this program is executed, MATLAB displays the following: 
xm fm 


3.200000 

2.650000 

2.925000 

3.062500 

2.993750 

3.028125 

3.010938 

3.002344 

2.998047 

3.000195 

2.999121 

2.999658 

2.999927 

3.000061 

2.999994 

3.000027 

3.000011 


0.037013 

-0.068779 

-0.014289 

0.011733 

-0.001182 

0.005299 

0.002065 

0.000443 

-0.000369 

0.000037 

-0.000166 

-0.000065 

-0.000014 

0.000012 

- 0.000001 

0.000005 

0.000002 
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3. 

From Example 2.5, 


y = f(x) = cos2x + sin2x + x - 1 


We use the following script to plot this function. 

x=-5:0.02:5; y=cos(2.*x)+sin(2.*x)+x-1; plot(x,y); grid 



Let us find out what a symbolic solution gives, 

syms x; y=cos(2*x)+sin(2*x)+x-1; solve(y) 

ans = 

[ 0 ] 

[ 2 ] 

The first value (0) is correct as it can be seen from the plot above and also verified by substi¬ 
tution of x = 0 into the given function. The second value (2) is not exactly correct as we can 
see from the plot. This is because when solving equations of periodic functions, there are an 
infinite number of solutions and MATLAB restricts its search for solutions to a limited range 
near zero and returns a non-unique subset of solutions. 

To find a good approximation of the second root that lies between x = 2 and x = 3 , we write 
and save the function files exercise3 and exercise3der as defined below. 

function y=exercise3(x) 

% Finding roots by Newton's method using MATLAB 
y=cos(2.*x)+sin(2.*x)+x-1; 

function y=exercise3der(x) 
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% Finding roots by Newton's method 
% The following is the first derivative of 
% the function defined as exercise3 
y=-2.*sin(2.*x)+2.*cos(2.*x)+1; 

Now, we write and execute the following program and we find that the second root is 
x = 2.2295 and this is consistent with the value shown on the plot. 

x = input('Enter starting value:'); 
fx = exercise3(x); 
fprimex = exercise3der(x); 
xnext = x-fx/fprimex; 
x = xnext; 
fx = exercise3(x); 
fprimex = exercise3der(x); 
disp(sprintf('First approximation is x = %9.6f \n', x)) 
while input('Next approximation? (<enter>=no,1=yes)'); 
xn ext=x-fx/f pri m ex; 
x=xnext; 
fx=exercise3(x); 
fprimex=exercise3der(x); 

disp(sprintf('Next approximation is x = %9.6f \n', x)) 
end; 

disp(sprintf('%9.6f \n', x)) 

Enter starting value: 3 

First approximation is x = 2.229485 
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Chapter 3 


Sinusoids and Phasors 


T his chapter is an introduction to alternating current waveforms. The characteristics of sinu¬ 
soids are discussed and the frequency, phase angle, and period are defined. Voltage and cur¬ 
rent relationships are expressed in sinusoidal terms. Phasors which are rotating vectors in 
terms of complex numbers, are also introduced and their relationships to sinusoids are derived. 


3.1 Alternating Voltages and Currents 

The waveforms shown in Figure 3.1 may represent alternating currents or voltages. 






Figure 3.1. Examples of alternating voltages and currents 

Thus an alternating current (AC) is defined as a periodic current whose average value over a period 
is zero. Stated differently, an alternating current alternates between positive and negative values 
at regularly recurring intervals of time. Also, the average of the positive and negative values over a 
period is zero. 
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Chapter 3 Sinusoids and Phasors 


As shown in Figure 3.1, the period T of an alternating current or voltage is the smallest value of 
time which separates recurring values of the alternating waveform. 

Unless otherwise stated, our subsequent discussion will be restricted to sine or cosine waveforms 
and these are referred to as sinusoids. Two main reasons for studying sinusoids are: (1) many phys¬ 
ical phenomena such as electric machinery produce (nearly) sinusoidal voltages and currents and 
(2) by Fourier analysis, any periodic waveform which is not a sinusoid, such as the square and saw¬ 
tooth waveforms on the previous page, can be represented by a sum of sinusoids. 


3.2 Characteristics of Sinusoids 


Consider the sine waveform shown in Figure 3.2, where f(t) may represent either a voltage or a 
current function, and let f(t) = Asint where A is the amplitude of this function. A sinusoid (sine 
or cosine function) can be constructed graphically from the unit circle, which is a circle with radius 
of one unit, that is, A = 1 as shown, or any other unit. Thus, if we let the phasor (rotating vector) 
travel around the unit circle with an angular velocity to, the coscot and sin cot functions are gen¬ 
erated from the projections of the phasor on the horizontal and vertical axis respectively. We 
observe that when the phasor has completed a cycle (one revolution), it has traveled 2 n radians or 
360° degrees, and then repeats itself to form another cycle. 




Figure 3.2. Generation of a sinusoid by rotation of a phasor 


At the completion of one cycle, t = T (one period), and since co is the angular velocity, com¬ 
monly known as angular or radian frequency, then 

| coT = 27T | or 

The term frequency in Hertz, denoted as Hz, is used to express the number of cycles per second. 
Thus, if it takes one second to complete one cycle (one revolution around the unit circle), we say 


(3.1) 
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that the frequency is 1 Hz or one cycle per second. 

The frequency is denoted by the letter f and in terms of the period T and (3.1) we have 

or | to = 27tf~| (3.2) 

The frequency f is often referred to as the cyclic frequency to distinguish it from the radian fre¬ 
quency co. 

Since the cosine and sine functions are usually known in terms of degrees or radians, it is conve¬ 
nient to plot sinusoids versus cot (radians) rather that time t. For example, v(t) = V max coscot, 
and i(t) = I max sincot are plotted as shown in Figure 3.3. 




By comparing the sinusoidal waveforms of Figure 3.3, we see that the cosine function will be the 
same as the sine function if the latter is shifted to the left by ji/2 radians, or 90° . Thus, we say 
that the cosine function leads (is ahead of) the sine function by n/2 radians or 90° . Likewise, if we 
shift the cosine function to the right by n/2 radians or 90° , we obtain the sine waveform; in this 
case, we say that the sine function lags (is behind) the cosine function by n/2 radians or 90° . 

Another common expression is that the cosine and sine functions are out-of-phase by 90° , or there is 
a phase angle of 90° between the cosine and sine functions. It is possible, of course, that two sinusoids 
are out-of-phase by a phase angle other than 90° . Figure 3.4 shows three sinusoids which are out- 
of-phase. If the phase angle between them is 0 ° degrees, the two sinusoids are said to be in-phase. 

We must remember that when we say that one sinusoid leads or lags another sinusoid, these are of 
the same frequency. Obviously, two sinusoids of different frequencies can never be in phase. 
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Chapter 3 Sinusoids and Phasors 



1.25sin(cot - cp) 
sin cot 

0.75sin(cot + 0) 


Figure 3.4. Out-of-phase sinusoids 

It is convenient to express the phase angle in degrees rather than in radians in a sinusoidal func¬ 
tion. For example, it is acceptable to express 

v(t) = 100sin(20007lt-7t/6) 
as 

v(t) = 100 sin(20007tt - 30°) 

since the subtraction inside the parentheses needs not to be performed. 

When two sinusoids are to be compared in terms of their phase difference, these must first be writ¬ 
ten either both as cosine functions, or both as sine functions, and should also be written with pos¬ 
itive amplitudes. We should remember also that a negative amplitude implies 180° phase shift. 


Example 3.1 

Find the phase difference between the sinusoids 

i l = 120cos(1007tt-30°) 


and 


i 2 = -6sin(1007lt-30°) 


Solution: 

We recall that the minus (-) sign indicates a +180° phase shift, and that the sine function lags the 
cosine by 90° . Then, 


and 


-sinx = sin(x + 180 ) and sinx = cos(x - 90 ) 
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i 2 = 6sin(1007lt - 210°) = 6sin(1007lt + 150°) 

= 6cos(1007it+ 150°-90°) = 6cos(1007it +60°) 
and comparing i 2 with i,, we see that i 2 leads ij by 90°, or ij lags i 2 by 90° . 


In our subsequent discussion, we will be using several trigonometric identities, derivatives and 
integrals involving trigonometric functions. We, therefore, provide the following relations and 
formulas for quick reference. Let us also review the definition of a radian and its relationship to 
degrees with the aid of Figure 3.5. 



Figure 3.5. Definition of radian 


As shown in Figure 3.5, the radian is a circular angle subtended by an arc equal in length to the 
radius of the circle, whose radius is r units in length. The circumference of a circle is 2nr units; 
therefore, there are 2n or 6.283... radians in 360° degrees. Then, 

1 radian = ^^- = 57.3° (3.3) 

2n 

The angular velocity is expressed in radians per second, and it is denoted by the symbol to. Then, 
a rotating vector that completes n revolutions per second, has an angular velocity to = 27tn radi¬ 
ans per second. 

Some useful trigonometric relations are given below for quick reference. 


cos0° - 

cos360° = cos27t = 1 

(3.4) 

cos 30° 

ii 

o 

II 

II 

o 

ON. 

Os 

(3.5) 

cos45° 

= cos- = = 0.707 

4 2 

(3.6) 

cos 60 

0 = cos- = - = 0.5 

3 2 

(3.7) 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


3-5 







Chapter 3 Sinusoids and Phasors 

cos 90° = cos- = 0 

2 

(3.8) 

cos 120° - cos 271 - _1 - 0.5 

3 2 

(3.9) 

cos 150° = cos— = =2^ = -0.866 

6 2 

(3.10) 

cos 180° = COS 71 = -1 

(3.11) 

cos210° = cos— = = -0.866 

6 2 

(3.12) 

cos 225° = cos— = = -0.707 

4 2 

(3.13) 

cos240° = cos— = — = -0.5 

3 2 

(3.14) 

3tt 

cos 270° = cos— = 0 

2 

(3.15) 

cos 300° = cos— = 0.5 

3 

(3.16) 

cos 330° = cos— = 0.866 

6 

(3.17) 

sin0° = sin360° = sin27t = 0 

(3.18) 

sin30° = sin- = - = 0.5 

6 2 

(3.19) 

sin45° = sin- - S = 0.707 

4 2 

(3.20) 

sin 60° = sm- = - = 0.866 

3 2 

(3.21) 

sin90° = sin- - 1 

2 

(3.22) 

sin 120° = sin— = £- = 0.866 

3 2 

(3.23) 
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sin 150° = sin— = - = 0.5 

6 2 

(3.24) 

sin 180° = sin7i = 0 

(3.25) 

sin210° = sin— = — = -0.5 

6 2 

(3.26) 

sin225° = sin— = ^ = -0.707 

4 2 

(3.27) 

sin240° = sin— = = -0.866 

3 2 

(3.28) 

sin270° = sin— = -1 

2 

(3.29) 

sin 300° = sin— = = -0.866 

3 2 

(3.30) 

sin330° = sin^-^ = — = -0.5 

6 2 

(3.31) 

cos(-0) = COS0 

(3.32) 

cos (90° + 0) = -sin0 

(3.33) 

cos(18O°-0) = -cos0 

(3.34) 

sin(-0) = -sin0 

(3.35) 

sin(90° + 0) = cos0 

(3.36) 

sin(180° - 0) = sin0 

(3.37) 

tan0 = 

(3.38) 

cos0 


CO10 = ^ = 

(3.39) 

sin0 tan0 

sec0 = — 

(3.40) 

COS0 


CSC0 = — 

sin0 

(3.41) 

tan(90° + 0) = —cot0 

(3.42) 
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tan(18O°-0) = -tan0 

(3.43) 

cos(0 + (|)) = cos0cos(|) - sin0sin(|) 

(3.44) 

cos(0-(|)) = cos0cos(|) + sin0sin(|) 

(3.45) 

sin(0 H- 4>) = sin0cos(|) + cos0sin(|) 

(3.46) 

sin(0 — 4>) = sin0cos<l)-cos0sin(|) 

(3.47) 

tan(0 + «- tan0 + ,m<l> 

1 - tan0tan(|) 

(3.48) 

tan(0 40 - 

1 + tan0tan(|) 

(3.49) 

cos 2 0 + sin 2 0 = 1 

(3.50) 

cos20 = cos 2 0-sin 2 0 

(3.51) 

sin20 = 2sin0cos0 

(3.52) 

tan26 = 2<an0 

1 - tan 2 0 

(3.53) 

cos 2 0 = |(1+ cos20) 

(3.54) 

sin 2 0 = ~(1 - cos20) 

(3.55) 

cos0cos<l) = ^cos(0 + <l)) + ^cos(0-<l)) 

(3.56) 

cos0sin(|) = ^sin(0 + (|))—sin(0 - (|)) 

(3.57) 

sin0cos(l) = ^sin(0 + (|)) + |sin(0 - (|)) 

(3.58) 

sin0sin(|) = |cos(0 - <j))-^cos(0 + (|)) 

(3.59) 


3-8 Numerical Analysis Using MATLAB® and Excel®, Third Edition 

Copyright ® Orchard Publications 








Characteristics of Sinusoids 


Let Figure 3.6 be any triangle. 


Then, 

by the law of sines, 
by the law of cosines, 


and by the law of tangents, 


Figure 3.6. General triangle 

a _ b _ c 
sin a sin (3 siny 

a 2 = b 2 + c 2 -2bccosa 
b 2 = a 2 + c 2 -2accosP 
c 2 = a 2 + b 2 - 2abcosy 


1 „ 


a + b , 1 , 

tan-(a + P) 


b - c 
b + c 


c - a 
c + a 


(3.60) 

(3.61) 

(3.62) 

(3.63) 

(3.64) 


The following differential and integral trigonometric and exponential functions, are used exten¬ 
sively in engineering. 


d , • N dv 

—(sinv) = cosv— 
dx dx 

(3.65) 

d , s . dv 

—(cosv) = -sinv— 
dx dx 

(3.66) 

rf(e v ) = 
dx dx 

(3.67) 

fsinaxdx = --cosax+ c 

J a 

(3.68) 

fcosaxdx = Isinax-tc 

J a 

(3.69) 

fe ax dx = -e ax + c 

J a 

(3.70) 
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Chapter 3 Sinusoids and Phasors 
3.3 Inverse Trigonometric Functions 

The notation cos -1 y or arccosy is used to denote an angle whose cosine is y. Thus, if y = cosx, 
thenx = cos _1 y- Similarly, if w = sinv, then v = sin _1 w, and if z = tanu, then u = tan _1 z. 
These are called Inverse Trigonometric Functions. 


Example 3.2 

Find the angle 0 if cos -1 0.5 = 0 

Solution: 

Here, we want to find the angle 0 given that its cosine is 0.5. From (3.7), cos60° = 0.5 . Therefore, 
0 = 60° 


3.4 Phasors 

In the language of mathematics, the square root of minus one is denoted as i, that is, i = 7-1 • In 
the electrical engineering field, we denote i as j to avoid confusion with current i. Essentially, j is 
an operator that produces a 90° counterclockwise rotation to any vector to which it is applied as a 
multiplying factor. Thus, if it is given that a vector A has the direction along the right side of the 
x-axis as shown in Figure 3.7, multiplication of this vector by the operator j will result in a new 
vector jA whose magnitude remains the same, but it has been rotated counterclockwise by 90°. 
Also, another multiplication of the new vector j A by j will produce another 90° counterclockwise 
direction. In this case, the vector A has rotated 180° and its new value now is -A. When this 
vector is rotated by another 90° for a total of 270°, its value becomes j(-A) = -j A. A fourth 90° 
rotation returns the vector to its original position, and thus its value is again A. Therefore, we 
conclude that j 2 = — 1, j 3 = — j, j 4 = 1, and the rotating vector A is referred to as a phasor. 

Note: In our subsequent discussion, we will designate the x -axis (abscissa) as the real axis, and the 
y -axis (ordinate) as the imaginary axis with the understanding that the “imaginary” axis is just as 
“real” as the real axis. In other words, the imaginary axis is just as important as the real axis. 

An imaginary number is the product of a real number, say r, by the operator j. Thus, r is a real 
number and jr is an imaginary number. 


* A more appropriate nomenclature for the real and imaginary axes would be the axis of the cosines and the axis of the sines 
respectively. 
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Addition and Subtraction of Phasors 


jA ' 

y 

' .A 

< 

ll 

< 

ll 

<T 

A 


j(-jA) = - 


j(-A) = j 3 A = -jA 
Figure 3.7. The j operator 


A complex number is the sum (or difference) of a real number and an imaginary number. For 
example, the number A = a + jb where a and b are both real numbers, is a complex number. 
Then, a = Re{A} and b = Im{A} where Re{A} denotes real part of A, and b = Im{A} the 
imaginary part of A. When written as A = a + jb, it is said to be expressed in rectangular form. 

Since in engineering we use complex quantities as phasors, henceforth any complex number will 
be referred to as a phasor. 

By definition, two phasors A and B where A = a+jb and B = c + jd, are equal if and only if 
their real parts are equal and also their imaginary parts are equal. Thus, A = B if and only if 
a = c and b = d. 


3.5 Addition and Subtraction of Phasors 


The sum of two phasors has a real component equal to the sum of the real components, and an 
imaginary component equal to the sum of the imaginary components. For subtraction, we change 
the signs of the components of the subtrahend and we perform addition. Thus, if A = a+jb and 
B = c +jd, then 


and 


A + B = (a + c)+j(b + d) 
A-B = (a-c) +j(b-d) 


Example 3.3 

It is given that A = 3 + j4, and B = 4 - j2. Find A + B and A-B 

Solution: 
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A + B = (3+j4) + (4-j2) = (3 + 4) + j(4 - 2) = 7+j2 
A - B = (3 + j4) — (4 — j2) = (3 - 4) + j(4 + 2) = - 1 +j6 


3.6 Multiplication of Phasors 

Phasors are multiplied using the rules of elementary algebra, and making use of the fact that 
j 2 = -1. Thus, if A = a +jb and B = c +jd, then 

AB = (a + jb) • (c + jd) = ac + jad + jbc + j 2 bd 
and since j 2 = -1, it follows that 

AB = ac+jad + jbc-bd = (ac-bd)+j(ad + bc) (3.71) 


Example 3.4 

It is given that A = 3 + j4 and B = 4 — j2 . Find A • B 

Solution: 

A B = (3 + j4) • (4 — j2) = 12 -j6 + jl6 -j 2 8 = 20 + j 10 


The conjugate of a phasor, denoted as A* , is another phasor with the same real component, and 
with an imaginary component of opposite sign. Thus, if A = a + jb, then A* = a-jb . 


Example 3.5 

It is given that A = 3 + j5 . Find A* 

Solution: 

The conjugate of the phasor A has the same real component, but the imaginary component has 
opposite sign. Then, A* = 3—j5 

If a phasor A is multiplied by its conjugate, the result is a real number. Thus, if A = a + jb, then 
A • A* = (a+jb)(a-jb) = a 2 -jab + jab-j 2 b 2 = a 2 + b 2 
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Division of Phasors 


Example 3.6 

It is given that A = 3 + j5 . Find A • A* 

Solution: 

A-A* = (3+j5)(3-j5) = 3 2 + 5 2 = 9 + 25 = 34 


3.7 Division of Phasors 

When performing division of phasors, it is desirable to obtain the quotient separated into a real 
part and an imaginary part. This procedure is called rationalization of the quotient, and it is done by 
multiplying the denominator by its conjugate. Thus, if A = a + jb and B = c +jd, then, 

A _ a + jb _ (a + jb)(c — jd) A IU (ac + bd) +j(bc - ad) 

B c+jd (c+jd)(c-jd) B b* c 2 + d 2 

(3.72) 

(ac + bd) • (be-ad) 
c 2 + d 2 c 2 + d 2 

In (3.72), we multiplied both the numerator and denominator by the conjugate of the denomina¬ 
tor to eliminate the j operator from the denominator of the quotient. Using this procedure, we 
see that the quotient is easily separated into a real and an imaginary part. 


Example 3.7 

It is given that A = 3 + j4, and B = 4 + j3 . Find A/B 

Solution: 

Using the procedure of (3.72), we get 

A _ 3+j4 = (3 + j4)(4 — j3) = 12 - j9 + j 16 + 12 
B 4 + j 3 (4+j3)(4-j3) 4 2 + 3 2 


' 25 J 25 ' 


3.8 Exponential and Polar Forms of Phasors 

The relations 

e j6 = cos 0 + jsin 0 

and 


(3.73) 
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e je = cos0-jsin0 

are known as the Euler’s identities. 

Multiplying (3.73) by the real positive constant C we get: 

Ce j9 = Ccos0+jCsin0 

This expression represents a phasor, say a + jb, and thus 


(3.74) 


(3.75) 


Ce je = a+jb (3.76) 

Equating real and imaginary parts in (3.75) and (3.76), we get 

a = Ccos0 and b = Csin0 (3.77) 

Squaring and adding the expressions in (3.77), we get 


a z + b z = (Ccos0) z + (Csin0) 2 = C 2 (cos 2 0 + sin 2 0) = C 


Then, 


Also, from (3.77) 


(3.78) 


© 


(3.79) 


Therefore, to convert a phasor from rectangular to exponential form, we use the expression 

a + jb = Ja 2 + b 2 e j ^ tan ^ (3.80) 

To convert a phasor from exponential to rectangular form, we use the expressions 


Ce j9 = Ccos0+jCsin0 
Ce -j0 = Ccos0-jCsin0 


(3.81) 
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Exponential and Polar Forms of Phasors 


The polar form is essentially the same as the exponential form but the notation is different, that is, 


= CZ0 


(3.82) 


where the left side of (3.82) is the exponential form, and the right side is the polar form. 

We must remember that the phase angle 0 is always measured with respect to the positive real axis, 
and rotates in the counterclockwise direction. 

In Examples 3.8 and 3.9 below, we will verify the results with the following MATLAB co-ordi¬ 
nate transformation functions: 

[theta,r] = cart2pol(x,y) - transforms from Cartesian to polar co-ordinates. 

[x,y] = pol2cart(theta,r) - transforms from polar to Cartesian co-ordinates 


Example 3.8 

Convert the following phasors to exponential and polar forms: 


a. 3 +j4 b. - 1+j2 c. -2-j d. 4 — j3 


Solution: 

a. The real and imaginary components of this phasor are shown in Figure 3.8. 


Im 



3 

Figure 3.8. The components of 3 + j4 


Then, 



Check with MATLAB: 

x=3+j*4; magx=abs(x); thetax=angle(x)*180/pi; disp(magx); disp(thetax) 


5 


53.1301 


or 
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x = 3; y = 4; [theta,r] = cart2pol(x,y), deg = theta*180/pi 

theta = 

0.9273 
r = 

5 

deg = 

53.1301 


We can also verify the result with Simulink® as shown in the model of Figure 3.9. The K 
value for the Gain block has been specified as 180/71 to convert radians into degrees. 



$ a j n Display 2 

Angle in degrees 


Figure 3.9. Simulink model for Example 3.8 (a) 
b. The real and imaginary components of this phasor are shown in Figure 3.10. 


Then, 



Figure 3.10. The components of - 1 + j2 


- 1 +j2 = Vl 2 + 2 2 e jtan (2/_1) = V5e jll6 ' 6 ° = V5Z116.6 0 = 2.236Z116.6 0 
Check with MATLAB: 

y=-1+j*2; magy=abs(y); thetay=angle(y)*180/pi; disp(magy); disp(thetay) 


* The reader who is not familiar with Simulink may skip this model and all others without loss of continuity. For 
an introduction to Simulink, please refer to “Introduction to Simulink with Engineering Applications”, ISBN 0- 
9744239-7-1. A brief introduction to Simulink is provided in Appendix B. 
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2.2361 

116.5651 

or 

x = -1; y = 2; [theta,r] = cart2pol(x,y), deg = theta*180/pi 

theta = 

2.0344 


2.2361 
deg = 

116.5651 

Check with the Simulink model of Figure 3.11: 



Gain Display 2 

Angle in degrees 


Figure 3.11. Simulink model for Example 3.8 (b) 
c. The real and imaginary components of this phasor are shown in Figure 3.12. 
Then, 


-2-jl = , 


75e j206 ' 6 ° = 75^206.6° = V5e j(_153 ' 4) ° = 2.236Z-153.4 0 



Figure 3.12. The components of - 2 - j 


Check with MATLAB: 

v=-2-j*1; magv=abs(v); thetav=angle(v)*180/pi; disp(magv); disp(thetav) 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


3-17 

















Chapter 3 Sinusoids and Phasors 

2.2361 

-153.4349 

or 

x = -2; y = -1; [theta,r] = cart2pol(x,y), deg = theta*180/pi 

theta = 

-2.6779 

r = 

2.2361 


deg = 

-153.4349 

Check with the Simulink model of Figure 3.13: 



Gain Display 2 

Angle in degrees 

Figure 3.13. Simulink model for Example 3.8 (c) 


d. The real and imaginary components of this phasor are shown in Figure 3.14. 


Then, 



Re 


Figure 3.14. The components of 4 - j 3 


4—j3 - M/4 > - 5e imJ ° = 5Z323.1° = = 5Z-36.9" 

Check with MATLAB: 

w=4-j*3; magw=abs(w); thetaw=angle(w)*180/pi; disp(magw); disp(thetaw) 
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5 

-36.8699 

or 

x = 4; y = -3; [theta,r] = cart2pol(x,y), deg = theta*180/pi 

theta = 

-0.6435 


5 


deg = 

-36.8699 

Check with the Simulink model of Figure 3.15: 



Gain Display 2 

Angle in degrees 


Figure 3.15. Simulink model for Example 3.8 (d) 


Example 3.9 

Express the phasor -2Z30 0 in exponential and in rectangular forms. 

Solution: 

We recall that -1 = j 2 . Since each j rotates a vector by 90° counterclockwise, then -2Z30 0 is 
the same as 2Z30° rotated counterclockwise by 180° . Therefore, 

-2Z30 0 = 2Z(30° + 180°) = 2Z210 0 = 2Z-150 0 
The components of this phasor are shown in Figure 3.16. 
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Then, 


Figure 3.16. The components of 2Z.— 150° 


2Z-150 0 = 2e 


-j 150° 


= 2(cosl50°-jsinl50°) = 2(-0.866-j0.5) = - 1.73-j 


Check with MATLAB: 

r = -2; theta = 30/pi; [x,y] = pol2cart(theta*180/pi,r) 

x = 


-1.7578 


Y ^ 

-0.9541 

Check with the Simulink model of Figure 3.17: 



Constant 2 


Angle in radians 

Figure 3.17. Simulink model for Example 3.9 


Note: The rectangular form is most useful when we add or subtract phasors; however, the expo¬ 
nential and polar forms are most convenient when we multiply or divide phasors. 


To multiply two phasors in exponential (or polar) form, we multiply the magnitudes and we add 
the phase angles, that is, if 


then, 


A = MZ0 and B = NZp 


AB = MNZ(0 + p) = Me j0 Ne j( ^ = MNe j(0 + ^ ) 


(3.83) 
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Example 3.10 

Multiply A = 12.58Z74.3 0 by B = 7.22Z-118.7 0 

Solution: 

Multiplication in polar form yields 

AB = (12.58 x7.22)Z[74.3° +(-118.7°)] = 90.83Z-44.4 0 
and multiplication in exponential form yields 

AB = (12.58e j74 - 3 °)(7.22e“ jll8 ' 7 °) = 90.83e j(74 ' 3 °“ 11870) = 90.83e “ j44 ' 4 ° 
Check with MATLAB: 

rl =12.58; r2=7.22; deg1=74.3; deg2=-118.7; r=r1*r2, deg=deg1+deg2 

r = 

90.8276 
deg = 

-44.4000 

Check with the Simulink model of Figure 3.18 : 



* It would certainly be a waste of time to use Simulink for such an application. It can be done faster with just 
MATLAB. The intent here is to introduce relevant Simulink blocks for more complicated models. 
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To divide one phasor by another when both are expressed in exponential or polar form, we divide 
the magnitude of the dividend by the magnitude of the divisor, and we subtract the phase angle of 
the divisor from the phase angle of the dividend, that is, if 


then, 


A = MZ6 and B = NZ<|> 


A 

B 


M j(0 -<j>) 
N C 


(3.84) 


Example 3.11 

Divide A = 12.58Z74.3 0 by B = 7.22Z-118.7 0 

Solution: 

Division in polar form yields 

A = 12.58Z74.3 0 = 1 . 74 ^ 74.30 _/_ n87 oj] = 1 . 74 ^ 193 ° = 1.74Z-167 0 
B 7.22Z-118.7 0 v ' 

Division in exponential form yields 

A = 12.58e J74,3 ° = 174 e j 74 . 3 = e jll 8 . 7 ° = 174 e jl93° = L74e -jl67» 

B 7 .22e _jU8 ' 7 ° 

Check with MATLAB: 

rl =12.58; r2=7.22; deg1=74.3; deg2=-118.7; r=r1/r2, deg=deg1-deg2 

r = 

1.7424 
deg - 
193 

Check with the Simulink model of Figure 3.19 : 


* Same comment as on the footnote of the previous page. 
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Constant 4 Angle in degrees 

Angle in radians. Phasor B 


Figure 3.19. Simulink model for Example 3.11 
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Chapter 3 Sinusoids and Phasors 
3.9 Summary 

• An alternating current (or voltage) alternates between positive and negative values at regularly 
recurring intervals of time. 

• The period T of an alternating current or voltage is the smallest value of time which separates 
recurring values of the alternating waveform. 

• Sine and cosine waveforms and these are referred to as sinusoids. 

• The angular velocity to is commonly known as angular or radian frequency and coT = 2n 

• The term frequency in Hertz, denoted as Hz, is used to express the number of cycles per sec¬ 
ond. The frequency is denoted by the letter f and in terms of the period T, f = 1/T. The fre¬ 
quency f is often referred to as the cyclic frequency to distinguish it from the radian frequency 
to. 

• The cosine function leads (is ahead of) the sine function by n/2 radians or 90°, and the sine 
function lags (is behind) the cosine function by n/2 radians or 90°. Alternately, we say that 
the cosine and sine functions are out-of-phase by 90° , or there is a phase angle of 90° between 
the cosine and sine functions. 

• Two (or more) sinusoids can be out-of-phase by a phase angle other than 90°. 

• It is important to remember that when we say that one sinusoid leads or lags another sinusoid, 
these are of the same frequency since two sinusoids of different frequencies can never be in 
phase. 

• It is customary to express the phase angle in degrees rather than in radians in a sinusoidal func¬ 
tion. For example, we write v(t) = 100sin(20007tt-7t/6) as v(t) = 100sin(20007tt - 30°) 

• When two sinusoids are to be compared in terms of their phase difference, these must first be 
written either both as cosine functions, or both as sine functions, and should also be written 
with positive amplitudes. 

• A negative amplitude implies 180° phase shift. 

• The radian is a circular angle subtended by an arc equal in length to the radius of the circle, 
whose radius is r units in length. The circumference of a circle is 2nr . 

• The notation cos _1 y or arccosy is used to denote an angle whose cosine is y. Thus, if 
y = cosx , thenx = cos“'y. These are called Inverse Trigonometric Functions. 

• A phasor is a rotating vector expressed as a complex number where j is an operator that 
rotates a vector by 90° in a counterclockwise direction. 
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Summary 


• Two phasors A and B where A = a + jb and B = c+jd, are equal if and only if their real 
parts are equal and also their imaginary parts are equal. Thus, A = B if and only if a = c and 
b = d. 

• The sum of two phasors has a real component equal to the sum of the real components, and an 
imaginary component equal to the sum of the imaginary components. For subtraction, we 
change the signs of the components of the subtrahend and we perform addition. Thus, if 
A = a + jb and B = c + jd, then A + B = (a + c) + j(b + d) and A - B = (a - c) + j(b - d) 

• Phasors are multiplied using the rules of elementary algebra. If A = a+jb and B = c+jd, 
then A • B = ac + jad + jbc-bd = (ac - bd) + j(ad + be) 

• The conjugate of a phasor, denoted as A* , is another phasor with the same real component, 
and with an imaginary component of opposite sign. Thus, if A = a + jb, then A* = a-jb . 

• When performing division of phasors, it is desirable to obtain the quotient separated into a 
real part and an imaginary part. This is achieved by multiplying the denominator by its conju¬ 
gate. Thus, if A = a +jb and B = c +jd, then, 

A _ a + jb _ (a + jb)(c — jd) _ (ac + bd) + j(bc - ad) _ (ac + bd) | . (be - ad) 

B c+jd (c + jd)(c — jd) c 2 + d 2 c 2 + d 2 J c 2 + d 2 


• The relations e^ 9 = cos0 +jsin0 and e J ° = cos0-jsin0 are known as the Euler’s identi¬ 
ties. 

• To convert a phasor from rectangular to exponential form, we use the expression 


Hi -2 j (tan -1 

a + jb = ya + b e v ^ 

To convert a phasor from exponential to rectangular form, we use the expressions 


Ce je = Ccos0+jCsin0 
Ce j9 = Ccos0-jCsin0 

• The polar form is essentially the same as the exponential form but the notation is different, 
that is, 

Ce j9 = CZ0 

and it is important to remember that the phase angle 0 is always measured with respect to the 
positive real axis, and rotates in the counterclockwise direction. 

• The rectangular form is most useful when we add or subtract phasors; however, the exponen¬ 
tial and polar forms are most convenient when we multiply or divide phasors. 
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• To multiply two phasors in exponential (or polar) form, we multiply the magnitudes and we 
add the phase angles, that is, if 

A = MZ0 and B = N ZQ 

then, 

AB = MNZ(0 + 4>) = Me j0 Ne j( ^ = MNe j(6 + W 

• To divide one phasor by another when both are expressed in exponential or polar form, we 
divide the magnitude of the dividend by the magnitude of the divisor, and we subtract the 
phase angle of the divisor from the phase angle of the dividend, that is, if 


then, 


A = MZ0 and B = NZf 


A M Me J 

- = -Z(0-<t>) = —— 

B N Ne j + 


M j(G-<)) 
N C 
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3.10 Exercises 

1. Perform the following operations, and check your answers with MATLAB. 

a. (2-j4) + (3+j4) b.(-3+j5)-(l+j6) c. (2-j3) - (2-j3)* d. (3 -j2)■(3 -j2)* 
e. (2-j4) ■ (3 +j5) f. (3-j2)-(-2-j3) g. (2-j4) • (3 + j5) • (3-j2) • (-2-j3) 

2. Perform the following operations, and check your answers with MATLAB. 


3+j2 ‘ - 3 - j ' 4-jlO (3-j2)* 

3. Any phasor A can be expressed as 

A = a+jb = r(cos0+jsin0) = re^ 6 
Using the identities (re J0 ) = r n e jn0 or l/rc J ° = l/re J0/n , compute: 

a. 6 Vl2+j5 b. l/l00V2(l -j) 

Check your answers with MATLAB 

4. Compute the exponential and polar forms of 


9 + j5 


-8+13 


- 4 - j2 -2+j4 

Check your answers with MATLAB. 

5. Compute the rectangular form of 


4Z30° 

5Z-150 0 


b. 


j60° 


-2e 


-j30= 


Check your answers with MATLAB 

6. Find the real and imaginary components of 


9 — j 4 
-5 +jx 
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3.11 Solutions to End-of-Chapter Exercises 

1 . 

a. (2-j4) + (3+j4) = 5 + 0 = 5 

b. (-3 +j5) - (1 +j6) = -4-j 

c. (2 -j3) - (2 -j3)* = (2 —j 3) - (2 +j3) = 0-j6 

d. (3-j2)-(3-j2)* = (3 - j2) • (3 +j2) = 9+j6-j6 + 4 = 13 

e. (2-j4) • (3 + j5) = 6 + j 10-j 12 + 20 = 26-j2 

f. (3 -j2) • (— 2 — j3) = — 6 — j9 + j4 - 6 = - 12 - j5 

(2 -j4) • (3 + j5) • (3 -j2) • (— 2 — j3) = (6 + j 10-j 12 + 20) • (- 6-j9 + j4 - 6) 

g. = (26 - j2) • (- 12 - j5) 

= - 312 - j 130 + j24 - 10 = - 322 - j 106 

Check with MATLAB: 

(2-4j)+(3+4j), (-3+5j)-(1+6j), (2-3j)-(2+3j), (3-2j)*(3+2j),... 

(2-4j)*(3+5j), (3—2j)*(—2—3j), (2-4j)*(3+5j)*(3-2j)*(-2-3j) 
ans = 


5 

ans = 

-4.0000 - l.OOOOi 
ans = 

0 - 6 . OOOOi 
ans = 

13 

ans = 

26.0000 - 2.OOOOi 
ans = 

-12.0000 - 5.OOOOi 
ans = 

-3.2200e+002 - 1.0600e+002i 
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22 + j 6 = 22 + j6 3-J2 _ 66 -j44 + j 18 + 12 _ 78-J26 _ 6 - 2 
a ' 3+j2 3+j2 3 - j2 3 2 + 2 2 13 J 

, 8 + j6 _ 8 + j6 -3+j _ -24 + j8-jl8-6 _ — 30 — i 10 _ , . 

• -3 - j — 3 — j —3+j 3 2 + 1 2 io J 

120 = 120 4 + j 10 = 480 +j 1200 = 480 . 1200 = 120 . 300 

4 - j 10 4 - j 10 4 + j 10 4 2 +io 2 116 J ' 116 29 J ’ 29 

, (3- J2) = (3- J2) (3- J2) = 9 — j6 — j6 — 4 = 5-J12 = _5_ _ . 12 

• (3 -j2)* (3+j2)'(3-j2) 3 2 + 2 2 13 13 J ' 13 

Check with MATLAB: 

22+6j)/(3+2j), (8+6j)/(-3-j), 120/(4-1 Oj), (3-2j)/(3+2j) 
ans = 

6 - 2i 
ans = 

-3 - li 
ans = 

120/29 + 300/29i 
ans = 

5/13 - 12/13i 


yi2T]5 - V5A 555 - yi3.e i0J94!/6 - 1 3 1/6 -e i °- 065! 

= 1.5334(cos0.0658 +jsin0.0658) = 1.53 +j0.10 

t/l0072(l -j) = Vl0072 • 72e “ j7l/4 = (100^2 • J2e~ in/4 ) W4 = (\00j2) lM ■ 

= (3.4485 x 1.0905)(cos(7t/16)-jsin(7t/16)) = 3.6883 -j0.7337 
Check with MATLAB: 

(12+5j) A (1/6), (100*sqrt(2)*(1 -j)) A (1/4) 
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ans = 

1.5301 + 0.1008i 
ans = 

3.6883 - 0.7337i 


J9 2 + 5 2 • 


. Jm ■ 


- 4 - j2 7?7?.e Jt “ 1( - 2/ - 4) V20-e j3 - 6052 

= 2.3022e“ j 1775081 ° = 2.3022Z-177.5081 0 


= 19105e'> 


-j 0.3588 


~\4/-2) 720 e - jU ° 71 

= 1.9105e j42 ' 8744 ° = 1.9105Z42.8744' 
Check with MATLAB: 
x=(9+5j)/(—4—2j); abs(x), angle(x)*180/pi,... 
y=(-8+3j)/(-2+4j); abs(y), angle(y)*180/pi 
ans = 

2.3022 
ans - 
-177.5104 
ans = 

1.9105 
ans = 

42.8789 


— = (4/5)Z180° = -0.8 


o —J3C 

-2e 


; = -0.5e j90 ° = -0.5(cos90° +jsin90°) = -0.5(0+j) = —j 0.5 
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Check with MATLAB: 

4*(cos(pi/6)+sin(pi/6)*j)/(5*(cos(-5*pi/6)+sin(-5*pi/6)*j)),... 

exp(pi*j/3)/(-2*exp(-pi*j/6)) 

ans = 

-0.8000 - O.OOOOi 


ans = 

-0.0000 - 0.5000i 

6 . 


9 — j4 = 9-j4 -5-jx = - 45 - j9x + j20 — 4x 

-5+jx -5+jx -5-jx 5 2 + x 2 


- 4x - 45 t j - 9x + 20 
x 2 + 25 x 2 + 25 
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Chapter 4 


Matrices and Determinants 


T his chapter is an introduction to matrices and matrix operations. Determinants, Cramer’s 
rule, and Gauss’s elimination method are introduced. Some definitions and examples are 
not applicable to subsequent material presented in this text, but are included for subject 
continuity, and reference to more advance topics in matrix theory. These are denoted with a dag¬ 
ger ( f ) and may be skipped. 


4.1 Matrix Definition 

A matrix is a rectangular array of numbers such as those shown below. 


[2 3 7] 


1 3 1 

I* -1 >\ 

or 

-2 1 -5 

4-7 6 


In general form, a matrix A is denoted as 


a 21 a 22 a 23 
a 31 a 32 a 33 


a 2n 

a 3n 


(4.1) 


The numbers a- are the elements of the matrix where the index i indicates the row, and j indi¬ 
cates the column in which each element is positioned. Thus, a 43 indicates the element posi¬ 
tioned in the fourth row and third column. 

A matrix of m rows and n columns is said to be of m x n order matrix. 


If m = n, the matrix is said to be a square matrix of order m (or n). Thus, if a matrix has five rows 
and five columns, it is said to be a square matrix of order 5. 


In a square matrix, the elements a n , a 22 , a 33 , ..., a nn are called the main diagonal elements. 
Alternately, we say that the matrix elements a n , a 22 , a 33 , ..., a nn , are located on the main 
diagonal. 
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t The sum of the diagonal elements of a square matrix A is called the trace of A. 
t A matrix in which every element is zero, is called a zero matrix. 

4.2 Matrix Operations 

Two matrices A = [aj and B = [by] are equal, that is, A = B , if and only if 

ay = by i = 1,2,3, ...,m j = 1,2,3, ..., n (4.2) 

Two matrices are said to be conformable for addition ( subtraction ), if they are of the same order 

If A = [ay] and B = [by] are conformable for addition (subtraction), their sum (difference) will 

be another matrix C with the same order as A and B, where each element of C is the sum (dif¬ 
ference) of the corresponding elements of A and B , that is, 

C = A + B = [ay + by] (4.3) 


Example 4.1 

Compute A + B and A - B given that 


Solution: 


1 2 3 
0 1 4 


and B = 


2 3 0 
-12 5 


n+2 

2 + 3 

3 + °l = l 

3 5 

3 1 

Lo-i 

1 + 2 

4 + 5j 

-1 3 


r >- 2 

2-3 

3-0l = 

r->-> 

3] 

[o+ 1 

1-2 

4-5J 

[1 -1 

4 


Check with MATLAB: 


A=[1 2 3; 0 1 4]; B=[2 3 0; -1 2 5]; % Define matrices A and B 

A+B % Add A and B 


* Henceforth, all paragraphs and topics preceded by a dagger ( t ) may be skipped. These are discussed in matrix theory text¬ 
books. 
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ans = 

3 5 3 

-13 9 

A-B 

ans = 

-1 -1 3 

1 -1 -1 


% Subtract B from A 


If k is any scalar (a positive or negative number), and not [k ] which is a 1 x 1 matrix, then mul¬ 
tiplication of a matrix A by the scalar k, is the multiplication of every element of A by k. 


Example 4.2 
Multiply the matrix 



by (a) kj = 5 and (b) k 2 = - 3 + j2 

Solution: 


•'-••[ilB:; ! ,r] 


5 -10 
10 15 


b. 


k 2 -A = (-3+J2) 

Check with MATLAB: 
k1=5; k2=(-3 + 2*j); 
A=[1 -2; 2 3]; 
k1*A 


Pi-21 _ [(-3 +j2)x 1 (-3 + j2) x (-2)1 _ 

[-3 +j2 

6-j4 

[_2 fl |M+j2)x2 (- 3 +j2) x3 J 

-6+j4 

-9+j6j 

% Define scalars k-\ and k 2 



% Define matrix A 




% Multiply matrix A by constant k-. 


5 -10 

10 15 

k2*A %Multiply matrix A by constant k 2 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


4-3 







Chapter 4 Matrices and Determinants 


ans = 

-3.0000+ 2.OOOOi 6.0000- 4.0000i 
-6.0000+ 4.OOOOi -9.0000+ 6.OOOOi 


Two matrices A and B are said to be conformable for multiplication A • B in that order, only when 
the number of columns of matrix A is equal to the number of rows of matrix B . That is, the prod¬ 
uct A • B (but not B • A) is conformable for multiplication only if A is an m x p and matrix B is 
an p x n matrix. The product A • B will then be an m x n matrix. A convenient way to determine 
if two matrices are conformable for multiplication is to write the dimensions of the two matrices 
side-by-side as shown below. 

Shows that A and B are conformable for multiplication 
a! I B 

m X p p x n 


Indicates the dimension of the product A • B 
For the product B • A we have: 

Here, B and A are not conformable for multiplication 

b riA 

p x n m x p 

For matrix multiplication, the operation is row by column. Thus, to obtain the product A • B, we 
multiply each element of a row of A by the corresponding element of a column of B ; then, we 
add these products. 


Example 4.3 
Given that 


C = [ 234 ] an d D = 
compute the products C • D and D • C 


1 

-1 

2 


Solution: 


The dimensions of matrices C and D are respectively 1x3 3x1; therefore the product C • D is 
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feasible, and will result in a lxl, that is, 


CD 


[2 3 4] 


= [(2) • (1) + (3) • (-1) + (4) • (2)] *j| 


The dimensions for D and C are respectively 3x1 1x3 and therefore, the product D • C is also 
feasible. Multiplication of these will produce a 3 x 3 matrix as follows. 


1 

D • C = _i [ 2 3 4 ] 

_ 2 _ 

Check with MATLAB: 

C=[2 3 4]; D=[1; -1; 2]; 

C*D 

ans = 

7 

D*C 

ans = 

2 3 4 

-2 -3 -4 

4 6 8 


r(i)•( 2 ) 

(1)• (3) 

(1)• (4) 


2 3 4 

(-1)•(2) 

(-1)' (3) 

(-1)'(4) 


-2 -3 -4 

L(2)-(2) 

(2)-(3) 

(2)-(4). 


4 6 8 


% Define matrices C and D 
% Multiply C by D 


% Multiply D by C 


Division of one matrix by another, is not defined. However, an equivalent operation exists, and it 
will become apparent later in this chapter, when we discuss the inverse of a matrix. 

4.3 Special Forms of Matrices 

t A square matrix is said to be upper triangular when all the elements below the diagonal are 
zero. The matrix A below is an upper triangular matrix. 


a H 

a 12 

a 13 ••• a ln 

0 

^2 

a 23 ••• a 2n 

0 

0 




0 S .A ... 

0 

0 

0 ... 
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In an upper triangular matrix, not all elements above the diagonal need to be non-zero. For 
applications, refer to Chapter 14. 

t A square matrix is said to be lower triangular, when all the elements above the diagonal are 
zero. The matrix B below is a lower triangular matrix. For applications, refer to Chapter 14. 


d M 0 0 ... 0 

&21 ^ • • • 0 

.\'. v 0 0 

.X 0 

a ml a m2 a m3 ••• X 


(4.5) 


In a lower triangular matrix, not all elements below the diagonal need to be non-zero. 

t A square matrix is said to be diagonal, if all elements are zero, except those in the diagonal. The 
matrix C below is a diagonal matrix. 


0 0 ... 0 

0 \ 2 0 ... 0 

C = 0 0 \\ 0 0 

0 0 0 X 0 

0 0 0 ... X 

t A diagonal matrix is called a scalar matrix, if a n = a 22 = a 33 
lar. The matrix D below is a scalar matrix with k = 4. 


(4.6) 


= k where k is a sca- 


4 0 0 0 
D _ 0 4 0 0 
0 0 4 0 
0 0 0 4 


(4.7) 


A scalar matrix with k = 1, is called an identity matrix I. Shown below are 2 x 2, 3x3, and 
4x4 identity matrices. 


1 0 0 
0 1 0 
0 0 1 


10 0 0 
0 10 0 
0 0 10 
0 0 0 1 


(4.8) 


The MATLAB eye(n) function displays an n x n identity matrix. For example, 
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eye(4)% Display a 4 by 4 identity matrix 
ans - 


10 0 0 
0 10 0 
0 0 10 
0 0 0 1 


Special Forms of Matrices 


Likewise, the eye(size(A)) function, produces an identity matrix whose size is the same as 
matrix A. For example, let A be defined as 

A=[1 3 1; -2 1 -5; 4 -7 6] % Define matrix A 

A - 

13 1 

-2 1 -5 

4-7 6 

then, 

eye(size(A)) 
displays 
ans - 

10 0 

0 10 

0 0 1 

t The transpose of a matrix A, denoted as A T , is the matrix that is obtained when the rows and 
columns of matrix A are interchanged. For example, if 



■ 

f 1 2 3 ] then A t = 

1 4 

2 5 

L 4 5 6 J 



3 6 


In MATLAB we use the apostrophe (') symbol to denote and obtain the transpose of a matrix. 
Thus, for the above example, 


A=[1 2 3; 4 5 6] % Define matrix A 

A = 

12 3 

4 5 6 
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A'% Display the transpose of A 

ans = 

1 4 

2 5 

3 6 

t A symmetric matrix A, is one such that A T = A, that is, the transpose of a matrix A is the 
same as A. An example of a symmetric matrix is shown below. 


A = 

1 2 3 

2 4-5 

a t = 

1 2 3 

2 4-5 


3 -5 6 


3 -5 6 


t If a matrix A has complex numbers as elements, the matrix obtained from A by replacing each 
element by its conjugate, is called the conjugate of A, and it is denoted as A* . 

An example is shown below. 


M j 1 

A*=[ 1 "j 2 “J ] 

L 3 2-j3j 

L 3 2+j3j 


t MATLAB has two built-in functions which compute the complex conjugate of a number. The 
first, conj(x), computes the complex conjugate of any complex number, and the second, 
conj(A), computes the conjugate of a matrix A. Using MATLAB with the matrix A defined as 
above, we obtain 

A = [1+2j j; 3 2-3j] % Define and display matrix A 

A = 

1.0000 + 2.OOOOi 0 + l.OOOOi 

3.0000 2.0000 - 3.OOOOi 

conj_A=conj(A) % Compute and display the conjugate of A 

conj_A = 

1.0000 - 2.OOOOi 0 - l.OOOOi 

3.0000 2.0000 + 3.OOOOi 

t A square matrix A such that A T = -A, is called skew-symmetric. For example, 


A = 

0 2-3 

-2 0 -4 

a t = 

0 -2 3 

2 0 4 


3 4 0 


-3 -4 0 
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Therefore, matrix A above is skew symmetric, 
t A square matrix A such that A T = A, is called Hermitian. For example, 


1 

1+j 

1-j 

3 

2 

j 

a t = 

1 

1-j 

1 +j 2 
3 -j 

a t * = 

1 

1-j 

1+j 

3 

2 

-j 

_ 2 

-j 

0 


_ 2 

j o_ 


_ 2 

j 

0 


Therefore, matrix A above is Hermitian. 

t A square matrix A such that A T = -A, is called skew-Hermitian. For example, 


j 1-j 
-1-j 3j 

2 

j 

a t = 

j 

1-j 

-1-j 

3j 

-2 

j 

a t * = 

-j 

1+j 

-1+j -2 

-3j -j 

-2 j 

0 


_ 2 

j 

0 


2 

-j o 


Therefore, matrix A above is skew-Hermitian. 


4.4 Determinants 

Let matrix A be defined as the square matrix 


a n a i2 a i3 a i, 


A = 


a 21 a 22 a 23 ''' a 2n 
a 31 a 32 a 33 a 3n 


_ a nl a n2 a n3 - a r 


then, the determinant of A, denoted as detA, is defined as 

detA = a n a 22 a 33 ...a nn + a l2 a 23 a 34 ...a nl + a 13 a 24 a 35 ...a n2 + ... 

_a nl--- a 22 a 13--- _a n2"’ a 23 a 14 _ a n 3"- a 24 a 15 - 

The determinant of a square matrix of order n is referred to as determinant of order n. 


(4.11) 


(4.12) 


Let A be a determinant of order 2 , that is, 



(4.13) 
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Then, 

detA = a n a 22 - a 21 a 12 (4.14) 


Example 4.4 

Given that 

A = 

compute detA and detB. 

Solution: 

detA = 
detA = 

Check with MATLAB: 

A=[1 2; 3 4]; B=[2 -1; 2 0]; % Define matrices A and B 

det(A) % Compute the determinant of A 

ans = 

-2 


1 2 and B = 2 - 1 
3 4 2 0 


1 • 4- 3 • 2 = 4-6 = -2 

2 - 0-2 - (- 1 ) = 0 - (- 2 ) = 2 


det(B) % Compute the determinant of B 

ans = 

2 

While MATLAB has the built-in function det(A) for computing the determinant of a matrix A, 
this function is not included in the MATLAB Run-Time Function Library List that is used with 
the Simulink Embedded MATLAB Function block.* The MATLAB user-defined function file 
below can be used to compute the determinant of a 2 x 2 matrix. 

% This file computes the determinant of a 2x2 matrix 
% It must be saved as function (user defined) file 
% det2x2.m in the current Work Directory. Make sure 
% that his directory is added to MATLAB's search 
% path accessed from the Editor Window as File>Set Path> 

% Add Folder. It is highly recommended that this 
% function file is created in MATLAB's Editor Window. 

% 

function y=det2x2(A); 


* For an example using this block, please refer to Introduction to Simulink with Engineering Applications, ISBN 
0-9744239-7-1, Page 16-3. 
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y=A(1,1)*A(2,2)-A(1,2)*A(2,1); 

% 

% To run this program, define the 2x2 matrix in 

% MATLAB's Command Window as A=[_] and then 

% type det2x2(A) at the command prompt. 


Let A be a matrix of order 3, that is, 


a ll a 12 a 13 
a 21 a 22 a 23 
a 31 a 32 a 33 


(4.15) 


then, detA is found from 

detA = a n a 22 a 3 3 + a 12 a 23 a 31 + a n a 22 a 33 (4 16) 

_a ll a 22 a 33 _ a ll a 22 a 33 _ a ll a 22 a 33 

A convenient method to evaluate the determinant of order 3, is to write the first two columns to 
the right of the 3x3 matrix, and add the products formed by the diagonals from upper left to 
lower right; then subtract the products formed by the diagonals from lower left to upper right as 
shown on the diagram of the next page. When this is done properly, we obtain (4.16) above. 

a ll a 12 a 13 a ll a 12 
a 21 a 22 a 23 a 21 a 22 

a 31 a 32 a 33 a 31 a 32 

This method works only with second and third order determinants. To evaluate higher order 
determinants, we must first compute the cofactors; these will be defined shortly. 



Example 4.5 

Compute detA and detB given that 


2 3 5 


2 -3 -4 

1 0 1 

and B = 

1 0 -2 

2 1 0 


0 -5 -6 
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\3AV 3 
detA = I o A r/o 
2 / 


Likewise, 


detA= (2x0x0)+ (3xlxl) +(5x1x1) 

-(2x0x5)-(1x1x2)-(0x1x3) = 11-2 = 9 

2-3-A, 2 -3 
detB = i 0^2^; 1^-2 
0 X 5 X 6 X 2^6 


detB= [2 x 0 x (-6)] + [(-3) x (-2) x 0] + [(-4) x 1 x (-5)] 

- [0 x 0 x (-4)] - [(-5) x (-2) x 2] - [(-6) x 1 x (-3)] = 20 - 38 = -18 


Check with MATLAB: 

A=[2 3 5; 1 0 1; 2 1 0]; det(A) 


% Define matrix A and compute detA 


ans = 

9 

B=[2 -3 -4; 1 0 -2; 0 -5 -6]; det(B) % Define matrix B and compute detB 


ans = 


-18 


The MATLAB user-defined function file below can be used to compute the determinant of a 
3x3 matrix. 


% This file computes the determinant of a 3x3 matrix 
% It must be saved as function (user defined) file 
% det3x3.m in the current Work Directory. Make sure 
% that his directory is added to MATLAB's search 
% path accessed from the Editor Window as File>Set Path> 
% Add Folder. It is highly recommended that this 
% function file is created in MATLAB's Editor Window. 


function y=det3x3(A); 

y=A(1,1)*A(2,2)*A(3,3)+A(1,2)*A(2,3)*A(3,1)+A(1,3)*A(2,1)*A(3,2)... 
-A(3,1)*A(2,2)*A(1,3)-A(3,2)*A(2,3)*A(1,1)-A(3,3)*A(2,1)*A(1,2); 


% To run this program, define the 3x3 matrix in 

% MATLAB's Command Window as A=[_] and then 

% type det3x3(A) at the command prompt. 
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4.5 Minors and Cofactors 

Let matrix A be defined as the square matrix of order n as shown below. 

a ll a 12 a 13 
a 21 a 22 a 23 


a nl a n2 a n3 ••• V 

If we remove the elements of its ith row, and jth column, the determinant of the remaining n - 1 
square matrix is called the minor of determinant A, and it is denoted as • 

The signed minor (-l) 1+ - i [jviJ is called the cofactor of a- and it is denoted as a- . 



Example 4.6 
Given that 


a ll a 12 a 13 
a 21 a 22 a 23 


a 31 a 32 a 33 


(4.18) 


compute the minors |m u J , [m 12 ] , [m 13 ] and the cofactors a n , a 12 and a 13 . 

Solution: 


K] = 


1 22 d 23 
*32 a 33 


I! 


and 


a n - ( _ i) [m h J - Jmu] a i2 - ( _ i) [mjJ --[i 


M= T T 

_ 31 a 32 

«13= [m 13 ] =(-!) 1 + 3 [m 13 ] 


The remaining minors 

[M*.]- K} [Mjj]- K]' [m 32 ]. [m 33 ] 

and cofactors 
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are defined similarly. 


(Xjj; 0622 ? OC 23 , a 31 , (x^) and K 33 


Example 4.7 

Given that 


A = 

1 2 -3 

2-4 2 


(4.19) 


-1 2 -6 



compute its cofactors. 

Solution: 





«12 = 

= (_1)1+2 [ 1 e] = 1 ° 

(4.20) 


[•" 


(4.21) 



I *- 4 

(4.22) 


a 32 : 

=< - i)3 "£t]=- 8 

(4.23) 


a 33 = (-1) 3 + 3 ^ 2j = -8 (4.24) 

It is useful to remember that the signs of the cofactors follow the pattern 


that is, the cofactors on the diagonals have the same sign as their minors. 

Let A be a square matrix of any size; the value of the determinant of A is the sum of the products 
obtained by multiplying each element of any row or any column by its cofactor. 
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Example 4.8 

Compute the determinant of A using the elements of the first row. 


Solution: 


A = 


1 2 -3 

2-4 2 

-1 2 -6 


(4.25) 


detA=l[- 4 2 l- 2 [ 2 

2 ]-3 [ 2 _4 | = 1 x20-2x 

L 2 -ej L-i 

-«J L-i 2 J 


Check with MATLAB: 

A=[1 2 -3; 2 -4 2; -1 2 -6]; det(A) % Define matrix A and compute detA 

ans - 
40 

The MATLAB user-defined function file below can be used to compute the determinant of 
4x4 matrix. 


We must use the above procedure to find the determinant of a matrix A of order 4 or higher. 
Thus, a fourth-order determinant can first be expressed as the sum of the products of the ele¬ 
ments of its first row by its cofactor as shown below. 


a n 

a 12 

a 13 

a 14 










a22 3-23 ^24 


a 12 a 13 a 14 

a 21 

a 22 

a 23 

a 24 









“ a ll 

a 32 a 33 a 34 

— a 21 

a 32 a 33 a 34 

a 31 

a 32 

a 33 

a 34 










a 42 a 43 a 44 


a 42 a 43 a 44 

a 41 

a 42 

a 43 

a 44 





*12 “13 “14 
i 22 a 23 a 24 

*42 a 43 a 44_ 


*12 “13 “14 
l 22 a 23 a 24 
l 32 a 33 a 34_ 


(4.26) 


Determinants of order five or higher can be evaluated similarly. 


Example 4.9 

Compute the value of the determinant 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


4-15 



















Chapter 4 Matrices and Determinants 


2 

-1 

0 

-3 

-1 

1 

0 

-1 

4 

0 

3 

-2 

-3 

0 

0 

1 


(4.27) 


Solution: 

Using the above procedure, we will multiply each element of the first column by its cofactor. 
Then, 


1 0 -1 

0 3-2 

-(- 1 ) 

-1 0 -3 

0 3-2 

+4 

-1 0 -3 

1 0 -1 

-(-3) 

-1 0 -3 

1 0 -1 

0 0 1 


0 0 1 


0 0 1 


0 3 -2 


[a] [b] [c] [d] 


Next, using the procedure of Example 4.5 or Example 4.8, we find 


[a] = 6 , [b] = -3 , [c] = 0 , [d] = -36 

and thus 

detA = [a] + [b] + [c] + [d] = 6-3+0-36 = -33 
We can verify our answer with MATLAB as follows: 

A=[2 -1 0 -3;-1 1 0 -1;4 0 3 -2; -3 0 0 1]; delta = det(A) 

delta = 

-33 

The MATLAB user-defined function file below can be used to compute the determinant of a 
n x n matrix. 

% This file computes the determinant of a nxn matrix 
% It must be saved as function (user defined) file 
% detnxn.m in the current Work Directory. Make sure 
% that his directory is added to MATLAB's search 
% path accessed from the Editor Window as File>Set Path> 

% Add Folder. It is highly recommended that this 
% function file is created in MATLAB's Editor Window. 

% 

function y=detnxn(A); 

% The following statement initializes y 

y=°; 

% The following statement defines the size of the matrix A 
[n,n]=size(A); 

% MATLAB allows us to use the user-defined functions to be recursively 
% called on themselves so we can call det2x2(A) for a 2x2 matrix, 

% and det3x3(A) for a 3x3 matrix. 


4-16 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 

















Minors and Cofactors 


if n==2 

y=det2x2(A); 

return 

end 

% 

if n==3 

y=det3x3(A); 

return 

end 

% For 4x4 or higher order matrices we use the following: 
% (We can define n and matrix A in Command Window 
for i=1 :n 

y=y+(-1)A(j+-|)*A(l,i)*detnxn(A(2:n, [1 :(i—1) (i+1):n])); 
end 

% 

% To run this program, define the nxn matrix in 

% MATLAB's Command Window as A=[_] and then 

% type detnxn(A) at the command prompt. 


Some useful properties of determinants are given below. 

Property 1: 

If all elements of one row or one column are zero, the determinant is zero. An example of this is the 
determinant of the cofactor [c] above. 

Property 2: 

If all the elements of one row or column are m times the corresponding elements of another row or col¬ 
umn, the determinant is zero. For example, if 


then, 


2 4 

3 6 
1 2 


1 

1 

1 


detA = 


2 4 1 

3 6 1 

1 2 1 


2 4 

3 6 
1 2 


12 + 4 + 6-6-4-12 = 0 


(4.28) 


(4.29) 


Here, detA is zero because the second column in A is 2 times the first column. 
Check with MATLAB: 

A=[2 4 1; 3 6 1; 1 2 1]; det(A) 

ans = 

0 
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Property 3: 

If two rows or two columns of a matrix are identical, the determinant is zero. This follows from Prop¬ 
erty 2 with m = 1. 


4.6 Cramer’s Rule 

Let us consider the systems of the three equations below 
anx + ai 2 y + ai3 z = A 

a 21 x + a 22 y+ a 23 z = B (4.30) 

a 31 x + a 32 y+ a 33 z = C 

and let 


a ll a 12 a 13 


A a n a 13 


a ll A a 13 


a ll a 12 A 

a 21 a 22 a 23 

Dj = 

B 3^2 \ ^23 

d 2 = 

3-21 B ^23 

d 3 = 

a 21 a 22 B 

a 31 a 32 a 33 


C a 31 a 33 


a 31 C a 33 


a 31 a 32 C 


Cramer’s rule states that the unknowns x, y, and z can be found from the relations 


D, 

x = — 1 

A 


(4.31) 


provided that the determinant A (delta) is not zero. 

We observe that the numerators of (4.31) are determinants that are formed from A by the substi¬ 
tution of the known values A, B, and C, for the coefficients of the desired unknown. 

Cramer’s rule applies to systems of two or more equations. 

If (4.30) is a homogeneous set of equations, that is, if A = B = C = 0, then, D,, D 2 , and D 3 are 
all zero as we found in Property 1 above. Then, x = y = z = 0 also. 


Example 4.10 

Use Cramer’s rule to find v 1; v 2 , and v 3 if 

2vj - 5 - v 2 + 3 v 3 = 0 

-2v 3 - 3v 2 - 4vj = 8 (4.32) 

v 2 + 3vj - 4 - v 3 = 0 

and verify your answers with MATLAB. 
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Solution: 

Rearranging the unknowns v, and transferring known values to the right side, we obtain 

2v l - v 2 + 3v 3 = 5 
-4v 1 -3v 2 -2v 3 = 8 
3vi + v 2 - v 3 = 4 


Now, by Cramer’s rule, 

A = 


2 -1 3 
-4 -3 -2 

3 1 -1 

5-13 
8 -3 -2 
4 1 -1 

2 5 3 

-4 8 -2 

3 4-1 

2-15 
-4 -3 8 

3 1 4 


2 -1 

_4 _3 =6 + 6-12 + 27 + 4 + 4 = 35 
3 1 

5 -1 

8 _ 3 = 15 + 8 + 24 + 36 + 10-8 = 85 
4 1 


2 5 


_ 4 8 = - 16 - 30 - 48 - 72 + 16 - 20 = -170 

3 4 

2 -1 

_4 _ 3 = - 24 - 24 - 20 + 45 - 16 - 16 = -55 
3 1 


Therefore, using (4.31) we obtain 


D i 

: A : 


170 . 
35 


_34 

7 


_55 . 
35 ‘ 


(4.33) 


(4.34) 


We will verify with MATLAB as follows. 


% The following script will compute 
format rat 

E3=[2 -1 3; -4 -3 -2; 3 1-1]; 
delta=det(B); 

d1=[5 -1 3; 8 -3 -2; 4 1 -1]; 
detd1=det(d1); 

d2=[2 5 3; -4 8 -2; 3 4 -1]; 
detd2=det(d2); 

d3=[2 -1 5; -4 -3 8; 3 1 4]; 
detd3=det(d3); 


display the values of v-|, v 2 and v 3 . 

% Express answers in ratio form 
% The elements of the determinant D 
% Compute the determinant D of B 
% The elements of D 1 
% Compute the determinant of D-| 

% The elements of D 2 
% Compute the determinant of D 2 
% The elements of D 3 
% Compute he determinant of D 3 
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v1=detd1/delta 

v2=detd2/delta 

v3=detd3/delta 


% Compute the value of v-| 
% Compute the value of v 2 
% Compute the value of v 3 


% 


disp('v1=');disp(v1) 

disp('v2=');disp(v2) 

disp('v3=');disp(v3) 


% Display the value of v-| 
% Display the value of v 2 
% Display the value of v 3 


vl= 

17/7 

v2 = 

-34/7 

v3 = 

-11/7 

These are the same values as in (4.34) 


4.7 Gaussian Elimination Method 

We can find the unknowns in a system of two or more equations also by the Gaussian elimination 
method. With this method, the objective is to eliminate one unknown at a time. This can be done 
by multiplying the terms of any of the equations of the system by a number such that we can add 
(or subtract) this equation to another equation in the system so that one of the unknowns will be 
eliminated. Then, by substitution to another equation with two unknowns, we can find the sec¬ 
ond unknown. Subsequently, substitution of the two values found can be made into an equation 
with three unknowns from which we can find the value of the third unknown. This procedure is 
repeated until all unknowns are found. This method is best illustrated with the following example 
which consists of the same equations as the previous example. 


Example 4.11 

Use the Gaussian elimination method to find v l5 v 2 , and v 3 of 


2vj - v 2 + 3 v 3 = 5 


-4vj - 3v 2 - 2v 3 = 8 
3vj + v 2 - v 3 = 4 


(4.35) 


Solution: 


As a first step, we add the first equation of (4.35) with the third to eliminate the unknown v 2 and 
we obtain the following equation. 
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5vj + 2 v 3 = 9 (4.36) 

Next, we multiply the third equation of (4.35) by 3, and we add it with the second to eliminate 
v 2 . Then, we obtain the following equation. 


5vj - 5 v 3 = 20 (4.37) 

Subtraction of (4.37) from (4.36) yields 

7v 3 = -11 or v 3 = (4.38) 

Now, we can find the unknown v x from either (4.36) or (4.37). By substitution of (4.38) into 
(4.36) we obtain 

5v 1 + 2.(-±i) = 9 or v 1 = H (4.39) 


Finally, we can find the last unknown v 2 from any of the three equations of (4.35). By substitu¬ 
tion into the first equation we obtain 


v 2 = 2v, + 3v 3 - 5 : 


7 7 7 

These are the same values as those we found in Example 4.10. 


(4.40) 


The Gaussian elimination method works well if the coefficients of the unknowns are small inte¬ 
gers, as in Example 4.11. However, it becomes impractical if the coefficients are large or fractional 
numbers. 

The Gaussian elimination is further discussed in Chapter 14 in conjunction with the LU factor¬ 
ization method. 

4.8 The Adjoint of a Matrix 

Let us assume that A is an n square matrix and a- is the cofactor of a- . Then the adjoint of A, 
denoted as adjA, is defined as the n square matrix shown on the next page. 
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adjA = 


a ll a 21 a 31 


U 12 u, 22 u, 32 
a 13 a 23 a 33 


(4.41) 


We observe that the cofactors of the elements of the ith row (column) of A, are the elements of 
the ith column (row) of adjA. 


Example 4.12 
Compute adjA given that 


2 3 

3 4 

4 3 


(4.42) 


adjA = 


> 

4l _[2 

3] \2 

4 


sj [4 

3J [3 

4J 

-ft 

4 1 [' 

3 1 4 2 

3 1 

[1 

3J |_1 

4 [3 

4J 

ft 

3 1 4 1 

2 1 f 1 

2 1 

[[1 

4J [1 

4J b 

4 


-7 6 -1 
1 0 -1 
1 -2 1 


4.9 Singular and Non-Singular Matrices 

An n square matrix A is called singular if detA = 0 ; if detA & 0, A is called non-singular. If an n 
square matrix A is nearly singular, that is, if the determinant of that matrix is very small, the 
matrix is said to be ill-conditioned. This topic is discussed in Appendix C. 


Example 4.13 

Given that 
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1 

2 

3 


2 3 

3 4 
5 7 


determine whether this matrix is singular or non-singular. 


Solution: 


detA = 


12 3 12 

2 3 4 2 3 

3 5 7 3 5 


21 +24 + 30-27-20-28 = 0 


Therefore, matrix A is singular. 


(4.43) 


4.10 The Inverse of a Matrix 

If A and B are n square matrices such that AB = BA = I, where I is the identity matrix, B is 
called the inverse of A, denoted as B = A -1 , and likewise, A is called the inverse of B , that is, 
A = B' 1 


If a matrix A is non-singular, we can compute its inverse from the relation 


(4.44) 


Example 4.14 
Given that 


1 2 3 
1 3 4 
1 4 3 


compute its inverse, that is, find A 1 


Solution: 


(4.45) 


Here, detA = 9 + 8 + 12-9-16-6 = -2, and since this is a non-zero value, it is possible to 
compute the inverse of A using (4-44). 

From Example 4.12, 
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Then, 


adjA = 


-7 6 -1 
1 0 -1 
1 -2 1 


\ 

-7 6 -1 


3.5 -3 

0.5 

-2 

1 0 -1 

= 

-0.5 0 

0.5 


1 -2 1 


-0.5 1 

-0.5 


(4.46) 


Check with MATLAB: 

A=[1 2 3; 1 3 4; 1 4 3], invA=inv(A) % Define matrix A and compute its inverse 

A = 

12 3 

13 4 

14 3 

invA = 

3.5000 -3.0000 0.5000 

-0.5000 0 0.5000 

-0.5000 1.0000 -0.5000 


Multiplication of a matrix A by its inverse A 1 produces the identity matrix I, that is, 

AA" 1 = I or A -1 A = I (4.47) 


Example 4.15 

Prove the validity of (4-47) for 


Proof: 


Then, 


and 


4 3 
2 2 


detA = 8-6 = 2 and adjA = 


2 -3 
-2 4 
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[ 4 

3 ][ 1 

-3/2] _ 

A 3 


2JL-1 

2 J 

[ 2-2 


= I 


4.11 Solution of Simultaneous Equations with Matrices 

Consider the relation 

AX = B (4.48) 

where A and B are matrices whose elements are known, and X is a matrix (a column vector) 
whose elements are the unknowns. We assume that A and X are conformable for multiplication. 
Multiplication of both sides of (4-48) by A -1 yields: 


A 'AX = A 'B = IX = A 'b 


or 

X=A"'B 


(4.49) 

(4.50) 


Therefore, we can use (4.50) to solve any set of simultaneous equations that have solutions. We 
will refer to this method as the inverse matrix method of solution of simultaneous equations. 


Example 4.16 

Given the system of equations 

2xj + 3 x 2 + x 3 = 9 
Xj + 2 x 2 + 3x 3 = 6 
3xj + x 2 + 2x 3 = 8 

compute the unknowns x 3 , x 2 , and x 3 using the inverse matrix method. 

Solution: 

In matrix form, the given set of equations is AX = B where 

2 3 ll x i [9 

1 2 3> x =x 2 ,B= 6 

3 1 2 J [x 3 J |_8_ 


A = 

Then, 


(4.51) 


(4.52) 
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X = A*B 


X 1 


2 3 1 

-1 

9 

x 2 

= 

1 2 3 


6 

x 3 


3 1 2_ 


8 


Next, we find the determinant detA, and the adjoint adjA. 


Therefore, 


detA =18 and adj A = 


1 -5 7 
7 1 -5 

-5 7 1 


A 1 = -—- adjA 
detA J 


1 1 
18 7 
-5 


-5 

1 

7 


7 

-5 

1 


and by (4.53) we obtain the solution as follows. 



x i 

\ 

1 -5 7 

9 

\ 

35 


35/18 


1.94 

X = 

x 2 

= 18 

7 1 -5 

6 

= 18 

29 

= 

29/18 

= 

1.61 


_ x 3_ 

-5 7 1 

8_ 

_5_ 


5/18 


0.28 


(4.53) 


(4.54) 


(4.55) 


To verify our results, we could use the MATLAB inv(A) function, and multiply A 1 by B . How¬ 
ever, it is easier to use the matrix left division operation X = A \ B ; this is MATLAB’s solution of 
A 1 B for the matrix equation A • X = B , where matrix X is the same size as matrix B . For this 
example, 

A=[2 3 1; 1 2 3; 3 1 2]; B=[9 6 8]';X=A\B % Observe that B is a column vector 

X = 

1.9444 

1.6111 

0.2778 

As stated earlier, while MATLAB has the built-in function det(A) for computing the determi¬ 
nant of a matrix A, this function is not included in the MATLAB Run-Time Function Library 
List that is used with the Simulink Embedded MATLAB Function block. The MATLAB user- 
defined function file below can be used to compute the determinant of a 2 x 2 matrix. A user- 
defined function to compute the inverse of an n x n is presented in Chapter 14. 
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Example 4.17 

For the electric circuit of Figure 4.1, the mesh equations are 


40 


Figure 4■ 1. Circuit for Example 4■ 1 7 
10Ij - 9I 2 = 100 

-9I 1 + 20I 2 -9I 3 = 0 (4.56) 

-9I 2 + 15I 3 = 0 

Use the inverse matrix method to compute the values of the currents I 1; I 2 , and I 3 . 

Solution: 

For this example, the matrix equation is RI = V or I = R ' V, where 




10 -9 0 


100 


Ij 

-9 20 -9 

, v = 

0 

and I = 

h 

0 -9 15 


0 


h 


The next step is to find R 1 . This is found from the relation 


; adjR 


(4.57) 


Therefore, we find the determinant and the adjoint of R. For this example, we find that 


detR = 975, 


adjR = 


219 135 81 
135 150 90 
81 90 119 


(4.58) 


Then, 


and 


219 135 81 
135 150 90 
81 90 119 
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h 

1 

219 

135 

81 

100 

100 

219 


22.46 

= 

h 

= 975 

135 

150 

90 

0 

= 975 

135 

= 

13.85 


h 


8! 

90 

119 

0 


81 


8.3! 


Check with MATLAB: 

R=[10 -9 0; -9 20 -9; 0 -9 15]; V=[100 0 0]'; l=R\V 

I = 

22.4615 

13.8462 

8.3077 

We can also use subscripts to address the individual elements of the matrix. Accordingly, the 
above script could also have been written as: 

R(1,1)=10; R(1,2)=-9; % No need to make entry for A(1,3) since it is zero. 

R(2,1)=-9; R(2,2)=20; R(2,3)=-9; R(3,2)=-9; R(3,3)=15; V=[100 0 0]'; l=R\V 

I = 

22.4615 

13.8462 

8.3077 

Spreadsheets also have the capability of solving simultaneous equations using the inverse matrix 
method. For instance, we can use Microsoft Excel’s MINVERSE (Matrix Inversion) and MMULT 
(Matrix Multiplication) functions, to obtain the values of the three currents in Example 4.17. 

The procedure is as follows: 

1. We start with a blank spreadsheet and in a block of cells, say B3:D5, we enter the elements of 
matrix R as shown in Figure 4.2. Then, we enter the elements of matrix V in G3:G5. 



A 1 

1 B | 

1 c | 

1 D 1 

r~j~i 

rn 

1 G 

H 

1 

Spreadsheet for Matrix Inversion and Matrix Multiplication 


2 









3 


10 

-9 

0 



100 


4 

R= 

-9 

20 

-9 


v= 

0 


5 


0 

-9 

15 



0 


6 









7 


0.225 

0.138 

0.083 



22.462 


8 

R" 1= 

0.138 

0.154 

0.092 


1= 

13.846 


9 


0.083 

0.092 

0.122 



8.3077 


10 










Figure 4.2. Solution of Example 4-17 with a spreadsheet 
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2. Next, we compute and display the inverse of R, that is, R 1 . We choose B7:D9 for the elements 
of this inverted matrix. We format this block for number display with three decimal places. 
With this range highlighted and making sure that the cell marker is in B7, we type the formula 

=MININVERSE(B3:D5) 

and we press the Crtl-Shift-Enter keys simultaneously. We observe that R _1 appears in these 
cells. 

3. Now, we choose the block of cells G7:G9 for the values of the current I. As before, we high¬ 
light them, and with the cell marker positioned in G7, we type the formula 

=MMULT(B7:D9,G3:G5) 

and we press the Crtl-Shift-Enter keys simultaneously. The values of I then appear in G7:G9. 


Example 4.18 

For the phasor circuit of Figure 4.3, the current I x can be found from the relation 



Figure 4.3. Circuit for Example 4.18 



and the voltages V 1 and V 2 can be computed from the nodal equations 


(4.59) 


Vj - 170Z0 0 

Vi-V 2 V t -0 

85 

100 

j200 

V 2 - 170Z0 0 

+ V iz v 1 

+ V 2 -0 

-jlOO 

100 

50 


(4.60) 


(4.61) 


Compute, and express the current I x in both rectangular and polar forms by first simplifying like 
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terms, collecting, and then writing the above relations in matrix form as YV = I, where 
Y = admittance, V = voltage, and I = current. 

Solution: 

The elements of the Y matrix are the coefficients of Vj and V 2 . Simplifying and rearranging the 
nodal equations of (4.60) and (4.61), we obtain 

(0.0218 -j0.005)V 1 -0.01V 2 = 2 
-O.OlVj + (0.03 +j0.01)V 2 = j 1.7 
Next, we write (4.62) in matrix form as 

fo.0218 - j0.005 -0.01 1 V! 

|_ -o.oi 0.03 + jO.OlJ V 2 

Y V I 

where the matrices Y, V, and I are as indicatedin (4.63). 

We will use MATLAB to compute the voltages V t and V 2 , and to do all other computations. 
The script is shown below. 

Y=[0.0218-0.005j -0.01; -0.01 0.03+0.01j]; I=[2; 1.7j]; V=Y\I; % Define Y, I, and find V 
fprintf('\n'); % Insert a line 

disp(' VI V2 1 ); dispf .'); % Display VI and V2 with dash line underneath 

fprintf('%9.3f %9.3f\n',V(1),V(2)) % Display values of VI and V2 in tabular form 

fprintf('\n')% Insert another line 

VI V2 

104.905 53.416 

Next, we find I x from 

R3=100; IX=(V(1 )-V(2))/R3 % Compute the value of l x 

ix = 

0.5149 - 0.0590i 

and this is the rectangular form of I x . For the polar form we use 

maglX=abs(IX) % Compute the magnitude of l x 

maglX = 
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0.5183 

thetalX=angle(IX)*180/pi % Compute angle theta in degrees 

thetalX = 

-6.5326 

Therefore, in polar form I x = 0.518Z-6.53 0 


Spreadsheets have limited capabilities with complex numbers, and thus we cannot use them to 
compute matrices that include complex numbers in their elements. 
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4.12 Summary 

• A matrix is a rectangular array of numbers whose general form is 

a 12 a 13 
a 22 a 23 
a 32 a 33 

a m2 a m3 ■" a mn 

The numbers a l f are the elements of the matrix where the index i indicates the row, and j 
indicates the column in which each element is positioned. A matrix of m rows and n columns 
is said to be of m x n order matrix. If m = n, the matrix is said to be a square matrix of order 
m. 


a 2n 

a 3n 



• Two matrices A = JjiJ and B = jby] are equal, that is, A = B, if and only if 

ay = by i = 1,2,3, ...,m j = 1, 2, 3, ..., n 

• Two matrices are said to be conformable for addition ( subtraction ), if they are of the same order 
mxn. If A = jay] and B = jb^ are conformable for addition (subtraction), their sum (dif¬ 
ference) will be another matrix C with the same order as A and B, where each element of C 
is the sum (difference) of the corresponding elements of A and B, i.e., 
C = A + B = [ay i by] 

• If k is any scalar (a positive or negative number), and not [k] which is a 1 x 1 matrix, then 
multiplication of a matrix A by the scalar k, is the multiplication of every element of A by k. 

• Two matrices A and B are said to be conformable for multiplication A • B in that order, only 
when the number of columns of matrix A is equal to the number of rows of matrix B . That is, 
the product A • B (but not B • A) is conformable for multiplication only if A is an m x p and 
matrix B is an p x n matrix. The product A • B will then be an m x n matrix. 

• For matrix multiplication, the operation is row by column. Thus, to obtain the product A • B , 
we multiply each element of a row of A by the corresponding element of a column of B ; then, 
we add these products. 

• Division of one matrix by another, is not defined. 
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Summary 


• A scalar matrix is a square matrix where a n = a 22 = a 33 = ... = a nn = k and k is a scalar. 

A scalar matrix with k = 1, is called an identity matrix I. 

• The MATLAB eye(n) function displays an n x n identity matrix and the eye(size(A)) func¬ 
tion displays an identity matrix whose size is the same as matrix A. 

• The transpose of a matrix A, denoted as A T , is the matrix that is obtained when the rows and 
columns of matrix A are interchanged. 

• The determinant of a square matrix A where 


*11 “12 “13 
*21 a 22 a 23 
hi a 32 a 33 


a ln 

a 2n 

a 3n 


a nl a n2 a n3 


a nn 


is denoted as detA and it is defined as 

detA = a n a 22 a 33 ...a nn + a 12 a 23 a 34 ...a nl + a 13 a 24 a 35 ...a n2 + ... 

_a nl''' a 22 a 13 — —S n2''' a 23 a 14 _ a n 3"- a 24 a 15 _ ••• 

• If from a matrix A be defined as 


a ll 

a 12 

a 13 

a ln 

a 21 

a 22 

a 23 - 

•• a 2n 

a 31 

a 32 

a 33 - 

- a 3n 

a n i 

a n2 

a n3 ■ 

.. a nn 


we remove the elements of its ith row, and jth column, the determinant of the remaining 
n - 1 square matrix is called the minor of determinant A , and it is denoted as [jvij . 


• The signed minor (-1)' +J [m^] is called the cofactor of ay and it is denoted as ay . 

• Let A be a square matrix of any size; the value of the determinant of A is the sum of the prod¬ 
ucts obtained by multiplying each element of any row or any column by its cofactor. We must 
use this procedure to find the determinant of a matrix A of order 4 or higher. 
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• Some useful properties of determinants are: 

a. If all elements of one row or one column are zero, the determinant is zero. 

b. If all the elements of one row or column are m times the corresponding elements of 
another row or column, the determinant is zero. 

c. If two rows or two columns of a matrix are identical, the determinant is zero. 

• Cramer’s rule states that if a system of equations is defined as 

a n x + a 12 y + a 13 z = A 
a 21 x + a 22 y + a 23 z = B 
a 31 x + a 32 y + a33Z = C 

and we let 


A = 

a ll a 12 a 13 

a 21 a 22 a 23 

Dj = 

A a n a 13 

B 3.21 3 23 

d 2 = 

a ll A a 13 
3-21 B &23 

d 3 = 

a ll a 12 A 


a 31 a 32 a 33 


C a 31 a 33 


a 31 C a 33 


a 31 a 32 C 


the unknowns x, y, and z can be found from the relations 



provided that the determinant A (delta) is not zero. 

• We can find the unknowns in a system of two or more equations also by the Gaussian elimina¬ 
tion method. With this method, the objective is to eliminate one unknown at a time. This can 
be done by multiplying the terms of any of the equations of the system by a number such that 
we can add (or subtract) this equation to another equation in the system so that one of the 
unknowns will be eliminated. Then, by substitution to another equation with two unknowns, 
we can find the second unknown. Subsequently, substitution of the two values found can be 
made into an equation with three unknowns from which we can find the value of the third 
unknown. This procedure is repeated until all unknowns are found. 

• If A is an n square matrix and oc^ is the cofactor of a^, the adjoint of A , denoted as adj A , is 
defined as the n square matrix below. 
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Summary 


a ll a 21 a 31 a nl 
a 12 a 22 a 32 ... a n2 

adjA = a 13 a 23 a 33 ... a n3 
a ln a 2n a 3n ... a nn 

• An n square matrix A is called singular if detA = 0 ; if detA * 0, A is called non-singular. 

• If A and B are n square matrices such that AB = BA = I, where I is the identity matrix, B is 
called the inverse of A, denoted as B = A -1 , and likewise, A is called the inverse of B , that is, 
A = B 1 

• If a matrix A is non-singular, we can compute its inverse from the relation 

1 

letA 

• Multiplication of a matrix A by its inverse A -1 produces the identity matrix I, that is, 

AA ^ 1 = I or A -1 A = I 

• If A and B are matrices whose elements are known, X is a matrix (a column vector) whose 
elements are the unknowns and A and X are conformable for multiplication, we can use the 
relation X=A 1 B to solve any set of simultaneous equations that have solutions. We refer to 
this method as the inverse matrix method of solution of simultaneous equations. 

• The matrix left division operation is defined as X = A \ B; this is MATLAB’s solution of 
A -1 B for the matrix equation A • X = B, where matrix X is the same size as matrix B. 

• We can use Microsoft Excel’s MINVERSE (Matrix Inversion) and MMULT (Matrix Multipli¬ 
cation) functions, to solve any set of simultaneous equations that have solutions. However, we 
cannot use them to compute matrices that include complex numbers in their elements. 
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4.13 Exercises 

For Exercises 1 through 3 below, the matrices A, B, C and D are defined as: 


1 -1 -4 

5 7-2 

B = 

5 9-3 

-2 8 2 

C= 

4 6 

-3 8 

d J 1 - 2 3 ] 

3 -5 6 


7-4 6 


_ 5 - 2 

L-3 6-4J 


1. Perform the following computations, if possible. Verify your answers with Excel or MATLAB. 

a. A + B b. A + C c. B + D d. C + D e. A-B f. A-C g. B-D h. C-D 

2. Perform the following computations, if possible. Verify your answers with Excel or MATLAB. 

a. A • B b. A • C c. B • D d. C • D e. B • A f. C • A g. D • A h. D • C 

3. Perform the following computations, if possible. Verify your answers with Excel or MATLAB. 

a. detA b. detB c. detC d. detD e. iet(A B) f. iet(A • C) 

4. Solve the following system of equations using Cramer’s rule. Verify your answers with Excel or 
MATLAB. 

Xj -2 x 2 + x 3 = -4 
-2xj + 3 x 2 + x 3 = 9 
3xj + 4 x 2 - 5x 3 = 0 

5. Repeat Exercise 4 using the Gaussian elimination method. 

6. Use the MATLAB det(A) function to find the unknowns of the system of equations below. 

- Xj + 2 x 2 - 3x 3 + 5x 4 = 14 
Xj + 3 x 2 + 2x 3 -x 4 = 9 
3 xj-3x 2 + 2x 3 + 4x 4 = 19 
4x x + 2 x 2 + 5x 3 + x 4 = 27 

7. Solve the following system of equations using the inverse matrix method. Verify your answers 
with Excel or MATLAB. 


1 3 4 


x i 


-3 

3 1 -2 


x 2 

= 

-2 

2 3 5_ 


_ x 3_ 


o' 
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Exercises 


8. Use Excel to find the unknowns for the system 







2 4 3 -2 


x i 


1 

2-413 


x 2 


10 

-1 3-42 


x 3 


-14 

2-2 2 1 


x 4 


7 


Verify your answers with the MATLAB left division operation. 
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4.14 Solutions to End-of-Chapter Exercises 
1 . 


1+5 -1+9 -4-3 
5-2 7+8 -2+2 
3+7 -5-4 6+6 


6 8-7 

3 15 0 

10 -9 12 


b. A + C not conformable for addition 


c. B + D not conformable for addition d. C + D not conformable for addition 


1-5 -1-9 -4+3 
5+2 7-8 -2-2 
3-7 -5+4 6-6 


-4 -10 -1 
7-1-4 
-4 -1 


f. A - C not conformable for subtraction 


g. B - D not conformable for subtraction h. C - D not conformable for subtraction 


1x5 + (-1) x (—2) + (—4) x 7 
5 x 5 + 7 x (-2) + (-2) x 7 
3x5 + (-5) x (-2) + 6x7 

-21 17 -29 
-3 109 -13 
67 -37 17 


1 x9 + (-l)x8 + (-4)x(-4) 
5x9 + 7x8 + (-2) x (-4) 
3x9 + (-5) x 8 + 6 x (-4) 


1 x(-3) + (-l)x2 + (-4)x6 
5 x (-3) + 7x2 + (-2) x 6 
3 x (-3) + (-5) x 2 + 6 x 6 


Check with MATLAB: 


-1 -4 

; 5 7 -2 

!; 3 -5 6]; B=[5 9 -3; -2 8 2; 7 -4 6]; A*B 

-21 

17 

-29 

-3 

109 

-13 

67 

-37 

17 


1x4 + (-1) x (-3) + (-4) x 5 1 x6 + (-l)x8 + (-4)x(-2) 

b. l-C= 5 x 4 + 7 x (-3) + (-2) x 5 5 x 6 + 7 x 8 + (-2) x (-2) 

3x4 + (-5) x (-3) + 6x5 3x6 + (-5) x 8 + 6 x (-2) _ 

c. B • D not conformable for multiplication 


-13 6 

= -11 90 

57 -34 


4 x 1 + 6x (-3) 4x(-2) + 6x6 4x3 + 6x(-4) 

(-3) x 1 + 8 x (-3) (-3) x (-2) + 8x6 (-3) x 3 + 8 x (-4) 

5x1+ (-2) x (-3) 5 x (-2) + (-2) x 6 5 x 3 + (-2) x (-4) 


-14 

28 

-i: 

-27 

54 

-4 

11 

-22 

23 
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BA 


5 x 1 + 9 x 5 + (-3) x 3 
5 x (-1) + 9x7 + (-3) x (-5) 
5 x (-4) + 9 x (-2) + (-3) x 6 


(-2) xl+8x5+2x3 
(-2) x (-1 ) + 8x7 + 2x (-5) 
(-2) x (-4) + 8 x (-2) + 2x6 


7x1+ (-4) x 5 + 6 x 3 
7 x (-1) + (-4) x 7 + 6 x (-5) 
7 x (-4) + (-4) x (-2) + 6x6 


41 73 -56 
44 48 4 

5 -65 16 


f. C • A not conformable for multiplication 


[" 1 x 1+(-2)x5 + 3x3 1 X (-1) + (-2) X 7 + 3 X (-5) 1 x (-4) + (-2) x (-2) + 3 x 6 1 

[(-3) x 1 + 6 x 5 + (-4) x 3 (-3) x (-1) + 6 x 7 + (-4) x (-5) (-3) x (-4) + 6 x (-2) + (-4) x 6j 

["0 -30 18~1 
|_15 65 -24j 


h. D C 


1x4 + (-2) x (-3) + 3x5 
|_(-3) x 4 + 6 x (-3) + (-4) x 5 


1x6 + (-2) x 8 + 3 x (-2) 1 
(-3) x 6 + 6 x 8 + (-4) x (-2)J 


25 -16 
1—50 38| 


3. 


1-1-4 1-1 
detA = 5 7 -2 5 7 

a. 3 -5 6 3 -5 

= 1x7x6 + (-1) x (-2) x 3 + (-4) x 5 x (-5) - [3 x 7 x (-4) + (-5) x (-2) x 1 + 6 x 5 x (-1)] 
= 42 + 6 + 100 - (-84) - 10 - (-30) = 252 

5 9 -3 5 9 
detB =-2 8 2 -2 8 

b. 7-467-4 

= 5x8x6 + 9x2x7 + (-3) x (-2) x (-4) - [7 x 8 x (-3) + (-4) x 2 x 5 + 6 x (-2) x 9] 

= 240 + 126 - 24 - (-168) + 40 - (-108) = 658 

c. detC does not exist; matrix must be square 

d. detD does not exist; matrix must be square 

e. et(A-B) = detA • det] and from parts (a) and (b), det(A-B) = 252x 658 = 165816 

f. det(A • C) does not exist because detC does not exist 
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4. 


1-2 1 1-2 
A = -2 3 1-2 3 

3 4 -5 3 4 

= 1 x 3 x (-5) + (-2) x 1 x 3 + 1 x (-2) x4-[3x3xl+4xlxl+(-5)x (-2) X (-2)] 
= -15-6-8-9-4 + 20 = -22 

-4 -2 1 4 -2 

D 1 = 9 3 19 3 

0 4 -5 0 4 

= -4 x 3 x (-5) + (-2) xlx0 + lx9x4-[0x3xl+4xlx4 + (-5) x 9 x (-2)] 

= 60 + 0 + 36-0 + 16-90 = 22 

1 -4 1 1-4 

d 2 = -2 9 1 -2 9 
3 0-5 30 

= 1 x 9 x (-5) + (-4) x 1 x 3 + 1 x (-2) x0-[3x9xl+0xlxl + (-5) x (-2) x (-4)] 
= - 45 - 12 - 0 - 27 - 0 + 40 = -44 

l_2-4 1 -2 
d 3 = -2 3 9 -2 3 
3 4 0 3 4 

= 1x3x0 + (-2) x 9 x 3 + (-4) x (-2) x 4 - [3 x 3 x (-4) + 4x9xl+0x (-2) x (-2)] 
= 0 - 54 + 32 + 36 - 36 - 0 = -22 


x i 



^2 _ -44 _ 2 


A -22 



-22 

-22 


5. 


Xj - 2 x 2 + x 3 = -4 (1) 
-2xj + 3 x 2 + x 3 = 9 (2) 
3xj + 4 x 2 -5x 3 = 0 (3) 


Multiplication of (1) by 2 yields 


2xj -4 x 2 + 2x 3 = -8 (4) 


Addition of (2) and (4) yields 


-x 2 + 3x 3 = 1 (5) 
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Multiplication of (1) by -3 yields 

-3xj + 6x 2 -3x 3 = 12 (6) 

Addition of (3) and (6) yields 

10x 2 - 8x 3 = 12 (7) 

-10x 2 + 30 x 3 = 10 (8) 
22x 3 = 22 (9) 

x 3 = 1 (10) 

10x 2 - 8 = 12 (11) 


Multiplication of (5) by 10 yields 


Addition of (7) and (8) yields 


Substitution of (10) into (7) yields 


x 2 = 2 ( 12 ) 

and substitution of (10) and (12) into (1) yields 

Xj - 4 + 1 = -4 (13) 


xj = -l (14) 


Delta=[—1 2 -3 5; 1 3 2 -1; 3 -3 2 4; 4 2 5 1] 
D1=[14 2 -3 5; 9 3 2 -1; 19 -3 2 4; 27 2 5 1] 

D2=[-1 14 -3 5; 1 9 2 -1; 3 19 2 4; 4 27 5 1] 

D3=[-1 2 14 5; 1 3 9 -1; 3 -3 19 4; 4 2 27 1] 

D4=[-l 2 -3 14; 1 3 2 9; 3 -3 2 19; 4 2 5 27]; 

x1=det(D1)/det(Delta), x2=det(D2)/det(Delta),... 
x3=det(D3)/det(Delta), x4=det(D4)/det(Delta) 
xl=1 x2=2 x3 = 3 x4 = 4 
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7. 


detA = 


13 4 13 
3 1-231 
2 3 5 2 3 


= 1 x 1 x 5 + 3 x (-2) x2 + 4x3x3-[2xlx4 + 3x (-2) x 1 + 5 x 3 x 3] 
= 5- 12 + 36-8 + 6-45 =-18 


adjA 


11 -3 -10 
-19 -3 14 

7 3-8 


11 -3 -10 
-19 -3 14 

7 3 -8 


-11/18 3/18 10/18 

19/18 3/18 -14/18 

-7/18 -3/18 8/18 


x 


1 


x 3 


-11/18 3/18 10/18 -3 

19/18 3/18 -14/18 -2 
-7/18-3/18 8/18 I 0 


33/18-6/18 + 0 
-57/18-6/18 + 0 
21/18 + 6/18 + 0 


27/18 

-63/18 

27/18 


1.50 


-3.50 

1.50 


Spreadsheet for Matrix Inversion and 
Matrix Multiplication - Exercise 7 


4 


1.00 

3.00 

4.00 


-3.00 

5 

A= 

3.00 

1.00 

-2.00 

B= 

-2.00 

6 


2.00 

3.00 

5.00 


0.00 

7 




8 


-0.61 

0.17 

0.56 


1.50 

9 

A' 1 

1.06 

0.17 

-0.78 

r x= 

-3.50 

10 


-0.39 

-0.17 

0.44 


1.50 
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Solutions to End-of-Chapter Exercises 



A 

B 

C DIE 1 

1 F | G | 

rn 

1 

Spreadsheet for Matrix Inversion and 



2 

Matrix Multiplication - Exercise 8 



3 




4 


2.00 

4.00 3.00 -2.00 


1.00 

5 

A= 

2.00 

-4.00 1.00 3.00 

B= 

10.00 

6 


-1.00 

3.00 -4.00 2.00 


-14.00 

7 


2.00 

-2.00 2.00 1.00 


7.00 

8 




9 


-1.58 

-4.08 1.17 6.75 


-11.50 

10 

A" 

0.58 

1.08 -0.17 -1.75 

X= 

1.50 

11 


1.50 

3.50 -1.00 -5.50 


12.00 

12 


1.33 

3.33 -0.67 -5.00 


9.00 


A=[2 4 3 -2; 2 -4 1 3;-1 3 -4 2; 2 -2 2 1]; 
B=[1 10-14 7]';A\B 

ans = 

-11.5000 

1.5000 

12.0000 

9.0000 
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Chapter 5 


Differential Equations , State Variables , and State Equations 


T his chapter is a review of ordinary differential equations and an introduction to state vari¬ 
ables and state equations. Solutions of differential equations with numerical methods is dis¬ 
cussed in Chapter 9. 

5.1 Simple Differential Equations 

In this section we present two simple examples to show the importance of differential equations in 
engineering applications. 

Example 5.1 

The current and voltage in a capacitor are related by 



(5.1) 


where i c (t) is the current through the capacitor, v c (t) is the voltage across the capacitor, and the 
constant C is the capacitance in farads (F). For this example C = 1 F and the capacitor is being 
charged by a constant current I. Find the voltage v c across this capacitor as a function of time 
given that the voltage at some reference time t = 0 is V 0 . 

Solution: 

It is given that the current, as a function of time, is constant, that is, 


i c (t) = I = constant 

By substitution of (5.2) into (5.1) we obtain 


(5.2) 



and by separation of the variables, 

dv c = Idt 

Integrating both sides of (5.3) we obtain 

v c (t) = It + k 

where k represents the constants of integration of both sides. 


(5.3) 


(5.4) 
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We can find the value of the constant k by making use of the initial condition, i.e., at t = 0, 
v c = V 0 and (5.4) then becomes 

V 0 = 0 + k (5.5) 

or k = V 0 , and by substitution into (5.4), 

v c (t) = It + V 0 (5.6) 

This example shows that when a capacitor is charged with a constant current, a linear voltage is pro¬ 
duced across the terminals of the capacitor. 


Example 5.2 

Find the current i L (t) through an inductor whose slope at the coordinate (t, i L ) is cost and the 
current i L passes through the point (7t/2,1). 

Solution: 

We are given that 

— = cost (5.7) 

dt 

By separating the variables we obtain 

di L = costdt (5-8) 

and integrating both sides we obtain 

i L (t) = sint + k (5.9) 

where k represents the constants of integration of both sides. 

We find the value of the constant k by making use of the initial condition. For this example, 
co = 1 and thus at cot = t = n/2 , i L = 1. With these values (5.9) becomes 

1 = sin^ + k (5.10) 

or k = 0, and by substitution into (5.9), 

i L (t) = sint (5.11) 


5.2 Classification 

Differential equations are classified by: 
1. Type - Ordinary or Partial 
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Classification 


2. Order - The highest order derivative which is included in the differential equation 

3. Degree - The exponent of the highest power of the highest order derivative after the differential 
equation has been cleared of any fractions or radicals in the dependent variable and its deriva¬ 
tives 

For example, the differential equation 



is an ordinary differential equation of order 4 and degree 2. 

If the dependent variable y is a function of only a single variable x, that is, if y = f (x) , the differ¬ 
ential equation which relates y and x is said to be an ordinary differential equation and it is abbrevi¬ 
ated as ODE. 

The differential equation 


di + 3^ + 2 = 5cos4t 
H , 2 d< 


dh 


is an ODE with constant coefficients. 
The differential equation 



is an ODE with variable coefficients. 

If the dependent variable y is a function of two or more variables such as y = f(x, t), where x 
and t are independent variables, the differential equation that relates y, x, and t is said to be a 
partial differential equation and it is abbreviated as PDE. 

An example of a partial differential equation is the well-known one-dimensional wave equation 
shown below. 


ty = a 2^y 

m 2 ;w 2 


0t 2 dx 


Most engineering problems are solved with ordinary differential equations with constant coeffi¬ 
cients; however, partial differential equations provide often quick solutions to some practical 
applications as illustrated with the following three examples. 
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Example 5.3 

The equivalent resistance R T of three resistors R,, R 2 , and R 3 in parallel is obtained from 


R t Rj r 2 r 3 

Given that initially Rj = 5 £2, R 2 = 20 Q, and R 3 = 4 Q, compute the change in R T if R 2 is 
increased by 10% and R 3 is decreased by 5% while R, does not change. 

Solution: 

The initial value of the equivalent resistance is R T = 5 II 20 II 4 = 2 Q. 

Now, we treat R 2 and R 3 as constants and differentiating R T with respect to R, we obtain 


Similarly, 


1 d R T _ 1_ dR T _ f R T V 


d R T _ f Y 

3R 2 " V r 2 ) 


and 


3Rt fM 2 
3R 3 VR 3 i 


and the total differential dR T is 


9R X 3R t 3R t fR r \ 2 f r t 2 

■ 3Fl dR ' + ^ + 3F> R ’ ■ CbtJ dR ' + (rp -Ms;) dF 

By substitution of the given numerical values we obtain 
dR T = 


Therefore, the eequivalent resistance decreases by 3 %. 


Example 5.4 

In a series RC electric circuit that is excited by a sinusoidal voltage, the magnitude of the imped¬ 
ance Z is computed from Z = Jr 2 + X c 2 . Initially, R = 4 Q, and X c = 3 0. Find the change 
in the impedance Z if the resistance R is increased by 0.25 Q (6.25%) and the capacitive reac¬ 
tance X c is decreased by 0.125 Q (-4.167%). 
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Solution: 

We will first find the partial derivatives ^ and ; then we compute the change in impedance 

C/rv (7 a^ 

from the total differential dZ. Thus, 


3Z 

0R‘ 






and 


dz = 8| dR + ^ dXc = RdR + X ^ X <- 

3 R ax r c 


Ap 


and by substitution of the given values 

dz = 4 (0,25) +3 (-0.12 5} = 1 -0-375 = Q U5 
5 

Therefore, if R increases by 6.25% and X c decreases by 4.167%, the impedance Z increases by 
4.167%. 


Example 5.5 

A light bulb is rated at 120 volts and 75 watts. If the voltage decreases by 5 volts and the resis¬ 
tance of the bulb is increased by 8 Q , by how much will the power change? 

Solution: 


At V = 120 volts and P = 75 watts, the bulb resistance is 


R = — = = 192 Q 

P 75 


and s 


and the total differential is 


_v 2 

R 2 


dP = § dV+ I dR = 




(-5)-^(8) = -9.375 
192 


That is, the power will decrease by 9.375 watts. 
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5.3 Solutions of Ordinary Differential Equations (ODE) 

A function y = f(x) is a solution of a differential equation if the latter is satisfied when y and its 
derivatives are replaced throughout by f(x) and its corresponding derivatives. Also, the initial 
conditions must be satisfied. 

For example a solution of the differential equation 


is 


A + y = 0 


y = kjsinx + k 9 cosx 


since y and its second derivative satisfy the given differential equation. 

Any linear, time-invariant system can be described by an ODE which has the form 


d y 

i —- + a 
dt n 


d" 

1 dt n 
d m x 


dy 

a i dt +a ° y 


d 

1 dt n 


x u dx , 

r + " +b idt +b ° x 


Excitation (Forcing) Function x(t) 

NON-HOMOGENEOUS DIFFERENTIAL EQUATION 


(5.12) 


If the excitation in (B12) is not zero, that is, if x(t) ± 0, the ODE is called a non-homogeneous 
ODE. If x(t) = 0, it reduces to: 


d y d 

a n — L + a n _ j — 
dt” dt‘ 

HOMOGENEOUS DIFFERENTIAL EQUATION 


• +a i| + a oy = ° 


(5.13) 


The differential equation of (5.13) above is called a homogeneous ODE and has n different linearly 
independent solutions denoted as yj(t), y 2 (t), y 3 (t), ..., y n (t). 


We will now prove that the most general solution of (5.13) is: 

y H (t) = ki yi(t) + k 2 y 2 (t) + k 3 y 3 (t) + ... + k n y n (t) (5.14) 

where the subscript H on the left side is used to emphasize that this is the form of the solution of 
the homogeneous ODE and k l5 k 2 , k 3 , ..., k n are arbitrary constants. 
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Proof: 

Let us assume that y, (t) is a solution of (5.13); then by substitution, 
d n yi d n ~ l y l _ dy x 


+ a 0 yi = 0 


n dt n dt*- 1 

A solution of the form kjyj(t) will also satisfy (5.13) since 


a n^( k i yi) + a n-i^n( k i yi) + •• • + a i^( k i yi) + a o( k i yi) 
dt dt 1 dt 


f d n yi d a Vt dyj 

= k^ n — + a n _ i — + ... + ai — + a ° yi j = 0 


(5.15) 


(5.16) 


If y = y 3 (t) and y = y 2 (t) are any two solutions, then y = y 2 (t) +y 2 (t) will also be a solution 
since 


and 


Therefore, 


d yi d Yi dyj 

l n— + a n-l^r7T + -.. +a l-^7 + a 0yi = 0 
dt dt at 


d n y 2 d" y 2 dy 2 

in-T +a n-l- —7 + ... + a l-T- + a 0 y2 = 0 

dt dt dt 


a n~7i(y 1 + ^2) + a n-1 ,(y 1 + y 2 ) + • •• + a i^(yi + y 2) + a o(yi + yi) 

dt dt at 

d n d n ~ l d 

= a— yi + a n-i-^7Tyi + -" + a iT t yi + a oyi 

dt dt at 

d n d n ~ 1 d 

+ a n—y2 + a n-i^rry2 + --- + a i3:y2 + a o y 2 = 0 

dt dt at 


In general, if 


y= k 1 y 1 (t),k 2 y 1 (t),k 3 y 3 (t), ...,k n y n (t) 


(5.17) 


are the n solutions of the homogeneous ODE of (5.13), the linear combination 
y= k iyi(t) + k 2 y 1 (t) + k 3 y 3 (t) + ... +k n y n (t) 

is also a solution. 

In our subsequent discussion, the solution of the homogeneous ODE, i.e., the complementary 
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solution, will be referred to as the natural response, and will be denoted as y N (t) or simply y N . The 
particular solution of a non-homogeneous ODE will be referred to as the forced response, and will 
be denoted as y F (t) or simply y F . Accordingly, we express the total solution of the non-homoge¬ 
neous ODE of (5.12) as: 


y(t) y Natural Y Forced yN Yf 
Response Response 


(5.18) 


The natural response y N contains arbitrary constants and these can be evaluated from the given 
initial conditions. The forced response y F , however, contains no arbitrary constants. It is impera¬ 
tive to remember that the arbitrary constants of the natural response must be evaluated from the 
total response. 


5.4 Solution of the Homogeneous ODE 

Let the solutions of the homogeneous ODE 


be of the form 



dy 

ll dt 


y = ke st 

Then, by substitution of (5.20) into (5.19) we obtain 


a 0 y = o 


a n ks n e s +a n _ 1 ks 11 e s + ... + kse s +a 0 ke s = 0 


or 

, n n-1 

(a n s -taj^s + ... 
We observe that (5.21) can be satisfied when 


+ a 0 )ke st = 0 


(5.19) 

(5.20) 


(5.21) 


(a n s n + a n _ j s° 1 + ... + aj s + a 0 ) = 0 or k = 0 or s = (5.22) 

but the only meaningful solution is the quantity enclosed in parentheses since the latter two yield 
trivial (meaningless) solutions. We, therefore, accept the expression inside the parentheses as the 
only meaningful solution and this is referred to as the characteristic (auxiliary) equation, that is, 


n n-1 „ 

a n s +a n _jS + ... + aj s + a 0 =0 
_ Characteristic Equation _ 


(5.23) 


Since the characteristic equation is an algebraic equation of an nth-power polynomial, its solutions 
are Sj, s 2 , s 3 , ..., s n , and thus the solutions of the homogeneous ODE are: 
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yi = k ie Slt , y 2 = k 2 e S2t , y 3 = k 3 e S3t , y n = k n e Snt (5.24) 

Case I - Distinct Roots 

If the roots of the characteristic equation are distinct (different from each another), the n solutions 
of (5.23) are independent and the most general solution is: 

y N = k ie Slt + k 2 e S2t + ... + k n e Snt (5 25 ) 

FOR DISTINCT ROOTS 

Case II - Repeated Roots 

If two or more roots of the characteristic equation are repeated (same roots), then some of the 
terms of (5.24) are not independent and therefore (5.25) does not represent the most general solu¬ 
tion. If, for example, s, = s 2 , then, 


s t t s 2 t Sjt Sjt Sjt Sjt 

kje + k 2 e = k t e +k 2 e = ( k i + k 2 )e = k 3 e 
and we see that one term of (5.25) is lost. In this case, we express one of the terms of (5.25), say 
k 2 e Slt as k 2 te Sl \ These two represent two independent solutions and therefore the most general 
solution has the form: 

y N = (kj + k 2 t)e Slt + k 3 e Sst + ... + k n e Snt (5.26) 

If there are m equal roots the most general solution has the form: 


y N = (k x +k 2 t+...+k m t m J )e 1 +k n _ i e S 2 t +...+k n e Snt (5 27) 

FOR M EQUAL ROOTS 

Case III - Complex Roots 

If the characteristic equation contains complex roots, these occur as complex conjugate pairs. 
Thus, if one root is Sj = -a+jP where a and P are real numbers, then another root is 
Sj = -a-jp.Then, 


+ k 2 e 2 = k ie “ at+jPt + k 2 e“ aHtit = e -at (k 1 e J ^ t + k 2 e -J ^ 
= e _at (kjCosPt + jkj sinPt + k 2 cosPt-jk 2 sinPt) 
= e _at [(k ] +k 2 )cosPt+j(k 1 -k 2 )sinPt] 

= e _at (k 3 cos Pt + k 4 sinPt) = e _at k 5 cos(Pt + (p) 
FOR TWO COMPLEX CONJUGATE ROOTS 


(5.28) 
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If (5.28) is to be a real function of time, the constants kj and k 2 must be complex conjugates. 
The other constants k 3 , k 4 , k 5 , and the phase angle (p are real constants. 

The forced response can be found by 

a. The Method of Undetermined Coefficients or 

b. The Method of Variation of Parameters 

We will study the Method of Undetermined Coefficients first. 

5.5 Using the Method of Undetermined Coefficients for the Forced Response 

For simplicity, we will only consider ODEs of order 2. Higher order ODEs are discussed in differ¬ 
ential equations textbooks. 

Consider the non-homogeneous ODE 



(5.29) 


where a, b, and c are real constants. 

We have learned that the total (complete) solution consists of the summation of the natural and 
forced responses. 

For the natural response, if y x and y 2 are any two solutions of (5.29), the linear combination 
y 3 = k, y, + k 2 y 2 , where k, and k 2 are arbitrary constants, is also a solution, that is, if we know 
the two solutions, we can obtain the most general solution by forming the linear combination of 
y x and y 2 . To be certain that there exist no other solutions, we examine the Wronskian Determi¬ 
nant defined below. 



(5.30) 


WRONSKIAN DETERMINANT 


If (5.30) is true, we can be assured that all solutions of (5.29) are indeed the linear combination of 
Yi and y 2 . 


The forced response is obtained by observation of the right side of the given ODE as it is illus¬ 
trated by the examples that follow. 
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Using the Method of Undetermined Coefficients for the Forced Response 
Example 5.6 

Find the total solution of the ODE 

^ + 4^ + 3y = 0 (5.31) 

dt 2 dt 

subject to the initial conditions y(0) = 3 and y'(0) = 4 where y' = dy/dt 

Solution: 

This is a homogeneous ODE and its total solution is just the natural response found from the char¬ 
acteristic equation s 2 + 4s + 3 = 0 whose roots are s, = -1 and s 2 = -3 . The total response is: 

y(t) = y N (t) = k ie _t + k 2 e“ 3t (5.32) 

The constants k, and k 2 are evaluated from the given initial conditions. For this example, 

y (0) = 3 = kje° + k 2 e° 
or 

k t +k 2 = 3 (5.33) 

Also, 

y'(0) = 4 = ^1 = -k.e^-Sk^e -31 

dt| t = 0 lt = o 

or 

-kj - 3k 2 = 4 (5.34) 

Simultaneous solution of (5.33) and (5.34) yields k, = 6.5 and k 2 = -3.5. By substitution into 
(5.32), we obtain 

y(t) = y N (t) = 6.5e _t - 3.5e _3t (5.35) 

Check with MATLAB: 

y=dsolve('D2y+4*Dy+3*y=0', 'y(0)=3', 'Dy(0)=4') 

y = 

(-7/2*exp(— 3 * t)*exp(t)+13/2)/exp(t) 

pretty(y) 

- 7/2 exp(-3 t) exp(t) + 13/2 
exp(t) 

The function y = f (t), of relation (5.35), shown in Figure 5.1, was plotted with the use of the 
MATLAB script 
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y=dsolve('D2y+4*Dy+3*y 

=0', 'y( 0 )= 3 ', l Dy(0)=4 l ); ezplot(y,[0 5]) 


3.5 

13/2 exp(-t)-7/2 exp(-31) 





2.5 























° 

1 

’341 


Figure 5.1. Plot for the function y = f (t) of Example 5.6. 

Example 5.7 




Find the total solution of the ODE 




+ 

+ 

II 

(5.36) 

subject to the initial conditions y(0) = 1 and y'(0) = -1 


Solution: 




The left side of (5.36) is the 

same as that of Example 5.6.Therefore, 



y N (t) = k i 

-t , -3t 

( e +k 2 e 

(5.37) 

(We must remember that the constants k, and k 2 must be evaluated from the total response). 

To find the forced response. 

, we assume a solution of the form 



y F = 

Ae 2t 

(5.38) 

We can find out whether our assumption is correct by substituting (5.38) into the given ODE of 

(5.36). Then, 

4Ae~ 2t -8Ae“ 2t 

- . -2t - -2t 

+ 3Ae = 3e 

(5.39) 

from which A = -3 and the total solution is 
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Using the Method of Undetermined Coefficients for the Forced Response 

y(t) = y N + y F = M -t + k 2 e _3t -3e -2t ( 5 . 40 ) 

The constants k, and k 2 are evaluated from the given initial conditions. For this example, 

y(0) = 1 = k 1 e 0 + k 2 e°-3e 0 
or 

k L + k 2 = 4 (5.41) 

Also, 

y'(0) = -1 = ^1 = -k 1 e _t -3k 2 e _3t +6e _2t | 

dt| t = 0 lt = o 

or 

-kj - 3k 2 = -7 (5.42) 

Simultaneous solution of (5.41) and (5.42) yields kj = 2.5 and k 2 = 1.5. By substitution into 
(5.40), we obtain 

y(t) = y N + y F = 2.5e~* + 1.5e _3t -3e _2t (5.43) 

Check with MATLAB: 

y=dsolve('D2y+4*Dy+3*y=3*exp(-2*t)', 'y(O) = 1', ’Dy(O) =—1') 

y - 

(-3*exp(-2*t)*exp(t)+3/2*exp(— 3 * t)*exp(t)+5/2)/exp(t) 

pretty(y) 

-3 exp(-2 t) exp(t) + 3/2 exp(-3 t) exp(t) + 5/2 
exp(t) 

The plot is shown in Figure 5.2 was produced with the MATLAB script 
y=dsolve('D2y+4*Dy+3*y=3*exp(-2*t)', 'y(O) = 1', ’Dy(O) =—1'); ezplot(y,[0 8]) 


Example 5.8 

Find the total solution of the ODE 

^l + 6^ + 9y = 0 (5.44) 

dt 2 dt 

subject to the initial conditions y(0) = -1 and y'(0) = 1 
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5/2 exp(-t)+3/2 exp(-31)-3 exp(-21) 


0.9 







0.8 




0.7 




0.6 




0.5 




0.4 




0.3 




0.2 




0.1 




0 

1 2 : 

3 4 1 


Figure 5.2. Plot for the function y 

= f(t) of Example 5.7. 

Solution: 




This is a homogeneous ODE and therefore its total solution is just the natural response found 
from the characteristic equation s 2 + 6s + 9 = 0 whose roots are Sj = s 2 = -3 (repeated roots). 
Thus, the total response is 


y(t) = y N = k ie 3t + k 2 te 3t 

(5.45) 

Next, we evaluate the constants kj and k 2 from the given initial conditions. For this example, 


y(0) = -1 = kje 0 

+ k 2 (0)e° 


or 

Also, 

k t = -l 


(5.46) 

cC 

•iT 

+ 

44 

m 

II 

-ol'O 

II 

II 

o 

V. 

t = 0 

or 

- 3kj + k 2 = 1 


(5.47) 

From (5.46) and (5.47) 

we obtain kj = -1 and k 2 = 

-2. By substitution into (5.45), 

Check with MATFAB: 

z, \ -3t -3t 

y(t) = -e -2te 

(5.48) 

y=dsolve('D2y+6*Dy+9*y=0', 'y(O) =—1', 'Dy(O) = 1') 

1 
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Using the Method of Undetermined Coefficients for the Forced Response 


-exp(-3*t)-2*exp(-3*t)*t 

The plot shown in Figure 5.3 was produced with the MATLAB script 

y=dsolve('D2y+6*Dy+9*y=0', V(0)=—1'Dy(0) = 1'); ezplot(y,[0 3]) 


-exp(-31)-2 exp(-31) t 



Figure 5.3. Plot for the function y = f (t) of Example 5.8. 


Example 5.9 

Find the total solution of the ODE 

^l + 5^ + 6y = 3e“ 2 * (5.49) 

dt 2 dt 

Solution: 

No initial conditions are given; therefore, we will express the solution in terms of the constants k, 
and k 2 . By inspection, the roots of the characteristic equation of (5.49) are Sj = -2 and s 2 = -3 
and thus the natural response has the form 

y N = Iqe -21 + k 2 e -3t (5.50) 

Next, we find the forced response by assuming a solution of the form 

y F = Ae _2t (5.51) 

We can find out whether our assumption is correct by substitution of (5.51) into the given ODE of 
(5.49). Then, 
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4Ae“ 2t - 10Ae“ 2t + 6Ae" 21 = 3e“ 2t (5.52) 

but the sum of the three terms on the left side of (5.52) is zero whereas the right side can never be 
zero unless we let t —» and this produces a meaningless result. 

The problem here is that the right side of the given ODE of (5.49) has the same form as one of the 
terms of the natural response of (5.50), namely the term kj e -2t . 

To work around this problem, we assume that the forced response has the form 

y F = Ate" 21 (5.53) 

that is, we multiply (5.51) by t in order to eliminate the duplication of terms in the total response. 
Then, by substitution of (5.53) into (5.49) and equating like terms, we find that A = 3 . There¬ 
fore, the total response is 

y(t) = y N + y F = kje- 2t + k 2 e- 3t + 3te- 2t (5.54) 

Check with MATLAB: 

y=dsolve('D2y+5*Dy+6*y=3*exp(-2*t)') 

Y = 

-3*exp(-2*t)+3*t*exp(-2*t)+Cl*exp(-3 *t)+C2*exp(-2*t) 

We observe that the first and last terms of the displayed expression above have the same form and 
thus they can be combined to form a single term C 3 * exp (- 2 * t) . 


Example 5.10 

Find the total solution of the ODE 

+5^ + 6y = 4cos5t (5.55) 

dt 2 dt 

Solution: 

No initial conditions are given; therefore, we will express solution in terms of the constants kj 
and k 2 . We observe that the left side of (5.55) is the same of that of Example 5.9. Therefore, the 
natural response is the same, that is, it has the form 

y N = kje -21 + k 2 e _3t (5.56) 

Next, to find the forced response and we assume a solution of the form 
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y F = Acos5t (5.57) 

We can find out whether our assumption is correct by substitution of the assumed solution of 
(5.57) into the given ODE of (5.56). Then, 

-25Acos5t - 25Asin5t + 6Acos5t = - 19Acos5t - 25Asin5t = 4cos5t 


but this relation is invalid since by equating cosine and sine terms, we find that A = -4/19 and 
also A = 0. This inconsistency is a result of our failure to recognize that the derivatives of Acos5t 
produce new terms of the form Bsin5t and these terms must be included in the forced response. 
Accordingly, we let 

y F = k 3 sin5t + k 4 cos5t (5.58) 

and by substitution into (5.55) we obtain 

-25k 3 sin5t- 25k 4 cos5t + 25k 3 cos5t- 25k 4 sin5t + 6k 3 sin5t + 6k 4 cos5t = 4cos5t 
Collecting like terms and equating sine and cosine terms, we obtain the following set of equations 


19k 3 + 25k 4 = 0 
25k 3 -19k 4 = 4 


(5.59) 


We use MATLAB to solve (5.59) 

format rat; [k3 k4]=solve(19*x+25*y, 25*x-19*y-4) 

k3 = 

50/493 
k4 = 

-38/493 

Therefore, the total solution is 


y(t) = y N + y F (t) = M 2t + k 2 e 3t + ^sin5t +J|cos5t (5.60) 

Check with MATLAB: 

y=dsolve('D2y+5*Dy+6*y=4*cos(5*t)'); y=simple(y) 

Y = 

-38/493*cos(5*t)+50/493*sin(5*t)+Cl*exp(-3 *t)+C2 *exp(-2 *t) 


In most engineering problems the right side of the non-homogeneous ODE consists of elementary 
functions such as k (constant), x n where n is a positive integer, e kx , coskx, sinkx, and linear 
combinations of these. Table 5.1 summarizes the forms of the forced response for a second order 
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ODE with constant coefficients. 

TABLE 5 .1 Form of the forced response for 2nd order differential equations 


Forced Response of the ODE + cy = f (t) 

dt 2 dt 

f(t) 

Form of Forced Response y F (t) 

k (constant) 

K (constant) 

kt n (n = positive integer) 

K 0 t n + K 1 t n_1 + ... + K n _jt + K n 

ke rt (r = real or complex) 

Ke rt 

k cos at or k sin at (a = constant) 

Kjcosat + K 2 sinat 

kt n e rt cosat or kt n e rt sinat 

(K 0 t n + K t t n “ 1 + ... + K n _ jt + K n )e rt cosat 
+ (K 0 t n + Kj t n “ 1 + ... + K n _ jt + KJe rt sinat 


We must remember that if f(t) is the sum of several terms, the most general form of the forced 
response y F (t) is the linear combination of these terms. Also, if a term in y F (t) is a duplicate of a 
term in the natural response y N (t), we must multiply y F (t) by the lowest power of t that will 
eliminate the duplication. 


Example 5.11 

Find the total solution of the ODE 

^ + 4 ly + 4 y = te “ 2t -e" 2t (5.61) 

dt 2 dt 

Solution: 

No initial conditions are given; therefore we will express solution in terms of the constants k , and 
k 2 . The roots of the characteristic equation are equal, that is, s, = s 2 = -2, and thus the natural 
response has the form 

y N = kje _2t + k 2 te _2t (5.62) 

To find the forced response (particular solution), we refer to the table of the previous page and 
from the last row we choose the term kt n e rt cosat. This term with n = 1, r = -2, and a = 0, 
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reduces to kte 2t . Therefore the forced response will have the form 

y F = (k 3 1 + k 4 )e -2t (5.63) 

But the terms e -2t and te _2t are also present in (5.61); therefore, we multiply (5.62) by t 2 to 
obtain a suitable form for the forced response which now is 

y F = (k 3 t 3 + k 4 t 2 )e“ 2t (5.64) 

Now, we need to evaluate the constants k 3 and k 4 . This is done by substituting (5.64) into the 
given ODE of (5.61) and equating with the right side. We use MATLAB do the computations as 
shown below. 

syms t k3 k4 % Define symbolic variables 

fO=(k3*t A 3+k4*t A 2)*exp(-2*t); % Forced response (5.64) 

fl =diff(fO); fl =simple(f 1) % Compute and simplify first derivative 

fl = 

-1 * exp(-2 * t)*(-3*k3*t-2*k4+2*k3*t^2+2*k4*t) 

f2=diff(f0,2); f2=simple(f2) % Compute and simplify second derivative 

f 2 = 

2 * exp (- 2 * t) * (3*k3*t+k4-6*k3*t02-4*k4*t+2*k3*t~3+2*k4*t / '2) 

f=f2+4*f1+4*f0; f=simple(f) % Form and simplify the left side of the given ODE 

f = 2 *(3 *k3 *t+k4)*exp(-2 *t) 

Finally, we equate f above with the right side of the given ODE, that is 

2(3k 3 t + k 4 )e" 2t = te“ 2t -e" 2t (5.65) 

and we find k 3 = 1/6 and k 4 = -1/2. By substitution of these values into (5.64) and combining 
the forced response with the natural response, we obtain the total solution 

y(t) = k 1 e -2t + k 2 te -2t + ^t 3 e 2t -|t 2 e 2t (5.66) 

We verify this solution with MATLAB as follows: 
z=dsolve('D2y+4*Dy+4*y=t*exp(-2*t)-exp(-2*t)') 
z - 

1/6 * exp(-2 * t)*t A 3-l/2*exp(-2*t)*t A 2 
+Cl*exp(—2 *t)+C2*t*exp(—2 * t) 
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5.6 Using the Method of Variation of Parameters for the Forced Response 

In certain non-homogeneous ODEs, the right side f(t) cannot be determined by the method of 
undetermined coefficients. For these ODEs we must use the method of variation of parameters. 
This method will work with all linear equations including those with variable coefficients such as 

^ + a(t)^ + P(t)y = f(t) (5.67) 

dt 2 dt 

provided that the general form of the natural response is known. 

Our discussion will be restricted to second order ODEs with constant coefficients. 

The method of variation of parameters replaces the constants kj and k 2 by two variables u, and 
u 2 that satisfy the following three relations: 


y = UjYi+i^ 


(5.68) 


duj di^ 

dT yi+ dT y2 


o 


(5.69) 


duj dyj du^ dy^ 

dt ' dt dt ' dt U 


(5.70) 


Simultaneous solution of (5.68) and (5.69) will yield the values of duj/dt and du 2 /dt; then, inte¬ 
gration of these will produce u, and u 2 , which when substituted into (5.67) will yield the total 
solution. 


Example 5.12 

Find the total solution of 

^ + 4 ^ + 3y=12 (5.71) 

dt 2 dt 

in terms of the constants k, and k 2 by the 

a. method of undetermined coefficients 

b. method of variation of parameters 

Solution: 

With either method, we must first find the natural response. The characteristic equation yields 
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the roots s x = —1 and s 2 = -3 . Therefore, the natural response is 

y N = k i e_t + k 2 e_3t (5-72) 

a. Using the method of undetermined coefficients we let y F = k 3 (a constant). Then, by substitu¬ 
tion into (5.71) we obtain k 3 = 4 and thus the total solution is 

y(t) = y N + y F = k ie _t + k 2 e" 3t + 4 (5.73) 

b. With the method of variation of parameters we begin with the natural response found above as 
(5.72) and we let the solutions y, and y 2 be represented as 


yj = e 1 and y 2 = e 3t 
Then by (5.68), the total solution is 

y = u iyi +u 2 y 2 


Also, from (5.69), 


and from (5.70), 


du, du-, 

-^-y, + 7fy2 = o 


duj _ t du 2 _ 3t 
—e +— e =0 
dt dt 


dyj d^2 dyg = 

dt dt dt dt 


du, _ t du 2 _ 3t 
^(-e V^(-3e 3t ) = 12 


(5.74) 


(5.75) 


(5.76) 


(5.77) 


Next, we find du, /dt and du 2 /dt by Cramer’s rule as follows: 


and 


duj 

"dt" 


12 -3e" 3t 



-12e~ 3t 

- 3 c -41 + e _4t 



(5.78) 
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du 2 
"d t 


12e 1 


-2e -2e 

Now, integration of (5.78) and (5.79) and substitution into (5.75) yields 
u x = 6jVdt = 6e* + k[ u 2 = -6jV*dt = -2e 3t + k 2 


y = Uje -t + u 2 e -3t = (6e l + kj)e _t + (-2e 3t + k 2 )e _3t 
= 6 + kje -1 - 2 + k 2 e _3t = kje _t + k 2 e _3t + 4 
We observe that the last expression in (5.81) is the same as (5.73) of part (a). 


Check with MATLAB: 

y=dsolve('D2y+4*Dy+3*y=12') 

Y = 

(4*exp (t) +Cl*exp (—3*t) *exp (t) +C2) /exp (t) 


(5.79) 


(5.80) 

(5.81) 


Example 5.13 

Find the total solution of 

l?-X + 4y = tan2t (5.82) 

dt 2 

in terms of the constants k, and k 2 by any method. 

Solution: 

This ODE cannot be solved by the method of undetermined coefficients; therefore, we will use 
the method of variation of parameters. 


The characteristic equation is s 2 + 4 = 0 from which s = +j2 and thus the natural response is 

y N = k 1 e j2t + k 2 e _j2t (5.83) 

We let 


yj = cos2t and y 2 = sin2t 

Then, by (5.68) the solution is 


(5.84) 


y = Ujyj+u^ = ^00821 +u 2 sin2t 


(5.85) 
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Also, from (5.69), 


du, du, 

= o 


or 

and from (5.70), 


du, du, 

— cos2t + -^sin2t = 0 
dt dt 


(5.86) 


du, dy, du, dy, du, du, 

-T 1 • -r 1 + -r ■ -P = f (t) = -—^-(-2sin2t) + —^(2cos2t) = tan2t 
dt dt dt dt w dt ' dt v ' 

Next, we find du,/dt and du 2 /dt by Cramer’s rule as follows: 


0 

tan2t 

sin2t 

2cos2t 

sin 2 2t 

cos2t 

-sin 2 2t 

cos2t 

-2 sin2t 

sin2t 

2cos2t ; , 

2cos 2 2t + 2sin 2 2t 

2cos2t 

du 2 

cos2t 

-2 sin2t 

° 

tan2t| _ sin2t 


"dt" = 

2 

2 



Now, integration of (5.88) and (5.89) and substitution into (5.85) yields 

u = _lrsm_2t d = sm2_t _ 1 ln(sec2t + tan2t ) + k 
1 2J cos2t 4 4 v ' 1 

u 2 = i J sin2tdt = - + k ^ 


(5.87) 


(5.88) 


(5.89) 


(5.90) 

(5.91) 


y = Ujy, + u 2 y 2 = s in2tcos2t _ l cos 2tln(sec2t + tan2t) + k 1 cos2t- s in2tcos2t + k 2 sin2t 

4 4 (5-92) 

= - -cos2tln(sec2t + tan2t) + kjCOs2t + k 2 sin2t 

Check with MATLAB: 
y=dsolve('D2y+4*y=tan(2*t)') 
y = 

-l/4*cos(2*t)*log((l+sin(2*t))/cos(2*t))+Cl*cos(2*t)+C2*sin(2*t) 
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5.7 Expressing Differential Equations in State Equation Form 

A first order differential equation with constant coefficients has the form 



(5.93) 


In a second order differential equation the highest order is a second derivative. 

An nth-order differential equation can be resolved to n first-order simultaneous differential equa¬ 
tions with a set of auxiliary variables called state variables. The resulting first-order differential 
equations are called state space equations, or simply state equations. The state variable method offers 
the advantage that it can also be used with non-linear and time-varying systems. However, our 
discussion will be limited to linear, time-invariant systems. 

State equations can also be solved with numerical methods such as Taylor series and Runge- 
Kutta methods; these will be discussed in Chapter 9. The state variable method is best illustrated 
through several examples presented in this chapter. 


Example 5.14 

A system is described by the integro-differential equation 



(5.94) 


Differentiating both sides and dividing by L we obtain 



(5.95) 


or 



(5.96) 


Next, we define two state variables Xj and x 2 such that 


Xi = 


(5.97) 


and 


di _ dx, 


(5.98) 


X2 dt dt 


= Xj 


Then, 


x 2 = d 2 i/dt 2 


(5.99) 
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(5.100) 


where x k denotes the derivative of the state variable x k . 

From (5.96) through (5.99), we obtain the state equations 

1 1 . 

-EE X ' + EJ C 

It is convenient and customary to express the state equations in matrix form. Thus, we write the 
state equations of (5.100) as 


(5.101) 

(5.102) 

and u = any input (5.103) 


We usually write (5.101) in a compact form as 

x = Ax + bu 


H 

1 , X. 

0 1 

1 R 


H 

1 , 

0 

1 . ion 

w 


_ LC ~ L 


kl 


L JC ° e 


The output y(t) is expressed by the state equation 
y = Cx + du 


(5.104) 


where C is another matrix, and d is a column vector. Therefore, the state representation of a sys¬ 
tem can be described by the pair of the of the state space equations 


x = Ax + bu 
y = Cx + du 


(5.105) 


The state space equations of (5.105) can be realized with the block diagram of Figure 5.1. 





Figure 5.4. Block diagram for the realization of the state equations of (5.105) 
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We will learn how to solve the matrix equations of (5.105) in the subsequent sections. 


Example 5.15 

A fourth-order system is described by the differential equation 

^7 + a 3^ + a 2^ + a iT + a oy(t) = U(t) (5.106) 

dt 4 dt 3 dt 2 dt 

where y(t) is the output and u(t) is any input. Express (5.106) as a set of state equations. 

Solution: 

The differential equation of (5.106) is of fourth-order; therefore, we must define four state vari¬ 
ables that will be used with the resulting four first-order state equations. 

We denote the state variables as x b x 2 , x 3 , and x 4 , and we relate them to the terms of the given 
differential equation as 


x, = y(t) x 2 = g 

We observe that 

*i = x 2 
x 2 = x 3 
x 3 = x 4 
d 4 y . 

—f = x 4 = -a 0 x, 
dt 

and in matrix form 


, = ^ 


*4 = ^ 

dt 


,x 2 - a 2 x 3 -a 3 x 4 + u(t) 


Xl 


0 10 0 

x i 

x 2 


0 0 10 

x 2 

x 3 


0 0 0 1 

x 3 

x 4 


—a 0 —a 3 —a 2 —a 3 

_X4 


0 

0 

0 

1 


u(t) 


In compact form, (5.109) is written as 

x - Ax + bu 


where 


(5.107) 


(5.108) 


(5.109) 


(5.110) 
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*1 


X 2 

, A = 

x 3 


*4 



0 10 0 

0 0 10 

0 0 0 1 

-a 0 -a] -a 2 -a-. 


and u = u(t) 


(5.111) 


5.8 Solution of Single State Equations 

Let us consider the state equations 

x = ax + Pu 
y = Iqx + k^u 

where a, P, k,, and k 2 are scalar constants, and the initial condition, if non-zero, is denoted as 
x 0 = x(t 0 ) (5.112) 

We will now prove that the solution of the first state equation in (5.111) is 


x(t) 


cc(t-t 0 ) atf 1 -ax 

= e x 0 + e e Pu(x)dx 


(5.113) 


Proof: 

First, we must show that (5.113) satisfies the initial condition of (5.112). This is done by substitu¬ 
tion of t = t 0 in (5.113). Then, 


x(t 0 ) = e a(t ° to) x 0 + e at j e aT pu(x)dT 


The first term in the right side of (5.114) reduces to x 0 since 

a(t 0 -t 0 ) o 

e x 0 = e x 0 = x 0 


(5.114) 


(5.115) 


The second term of (5.114) is zero since the upper and lower limits of integration are the same. 
Therefore, (5.114) reduces to x(t 0 ) = x 0 and thus the initial condition is satisfied. 

Next, we must prove that (5.113) satisfies also the first equation in (5.111). To prove this, we dif¬ 
ferentiate (5.113) with respect to t and we obtain 


x(t) = ^(e“ (t l ° )x o) + e aT Pu(x)dx 
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a(t-t 0 ) atf * -ax at -ax 

x(t) = ae x 0 + ae J e Pu(T)dx + e [e Pu(t)] | T = t 

r a(t-t 0 ) atf 1 -ax 1 at -at 

= a|^e x 0 + e J e Pu(x)dTj + e e Pu(t) 


x(t)= a|^e ( °^ x o + | e<X ^ T ^u(x)dxJ + Pu(t) 


(5.116) 


We observe that the bracketed terms of (5.116) are the same as the right side of the assumed solu¬ 
tion of (5.113). Therefore, 

x = ax + Pu 

and this is the same as the first equation of (5.111). The second equation of (5.111) is an algebraic 
equation whose coefficients are scalar constants. 

In summary, if a and p are scalar constants, the solution of 


with initial condition 


x = ax + Pu 


(5.117) 


is obtained from the relation 


x 0 = x(t 0 ) 


(5.118) 


x(t) = 


Pu(x)dx 


(5.119) 


5.9 The State Transition Matrix 

Let us again consider the state equations pair 


x = Ax + bu 
y = Cx + du 


(5.120) 


where for two or more simultaneous differential equations A and C are 2 x 2 or higher order 
matrices, and b and d are column vectors with two or more rows. In this section we will intro¬ 


duce the state transition matrix e At , and we will prove that the solution of the matrix differential 
equation 


x = Ax + bu (5.121) 

with initial conditions 

x(t 0 ) = x 0 (5.122) 

is obtained from the relation 
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,, N A(t-t 0 ) Atf 1 -Ax, , , , 

x(t) = e x 0 + e e bu(x)dT 

J ‘o 


(5.123) 


Proof: 

Let A be any n x n matrix whose elements are constants. Then, another n x n matrix denoted as 
cp(t), is said to be the state transition matrix of (5.34), if it is related to the matrix A as the matrix 
power series 


(p(t) = e At = I + At + A 2 t 2 + 7 :A 3 t 3 + ... + A n t n 
2! 3! n! 

where I is the n x n identity matrix. 

From (5.124), we find that 

<p(0) = e A ° = I + A0+ ... = I 
Differentiation of (5.124) with respect to t yields 


(5.124) 


(5.125) 


and by comparison with (5.124) we obtain 


d At .At 

—e = Ae 

dt 


(5.126) 


(5.127) 


To prove that (5.123) is the solution of the first equation of (5.120), we must prove that it satisfies 
both the initial condition and the matrix differential equation. The initial condition is satisfied 
from the relation 


/, \ A(tp tg) At 0 o —At, / . , AO — T r r , oo\ 

x(t 0 ) = e x 0 + e e bu(x)dx = e x 0 + 0 = Ix 0 = x 0 (5.128) 

where we have used (5.125) for the initial condition. The integral is zero since the upper and lower 
limits of integration are the same. 

To prove that the first equation of (5.120) is also satisfied, we differentiate the assumed solution 

... A(t —1 0 ) At r 1 -At, , . , 

x(t) = e x 0 + e e bu(x)dx 


with respect to t and we use (5.127), that is, 


d At .A 

—e - Ae 
dt 
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Then, 


x(t) = Ae °^x 0 + Ae At J e Ax bu(x)dT + e At e At bu(t) 
or 

x(t) = A^e ^ to ^x 0 + e At | e _AT bu(T)dxj + e At e _At bu(t) (5.129) 

We recognize the bracketed terms in (5.129) as x(t), and the last term as bu(t). Thus, the expres¬ 
sion (5.129) reduces to 

x(t) = Ax + bu 

In summary, if A is an n x n matrix whose elements are constants, n > 2, and b is a column vec¬ 
tor with n elements, the solution of 


with initial condition 


x(t) = Ax + bu 
x 0 = x(t 0 ) 


(5.130) 

(5.131) 


is 


A(t-t 0 ) Atr* _At, , , , 

x(t) = e x 0 + e e bu(x)dx 

J ‘o 


(5.132) 


Therefore, the solution of second or higher order systems using the state variable method, entails 
the computation of the state transition matrix e At , and integration of (5.132). 


5.10 Computation of the State Transition Matrix e At 

Let A be an n x n matrix, and I be the n x n identity matrix. By definition, the eigenvalues L;, 
i = 1, 2, ..., n of A are the roots of the nth order polynomial 


det[A-M] = 0 


(5.133) 


We recall that expansion of a determinant produces a polynomial. The roots of the polynomial of 
(5.133) can be real (unequal or equal), or complex numbers. 


Evaluation of the state transition matrix e At is based on the Cayley-Hamilton theorem. This theo¬ 
rem states that a matrix can be expressed as an (n - l)th degree polynomial in terms of the matrix 
A as 


e = aJ + a^ + ajA + ... + a n _!A 


(5.134) 
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where the coefficients a i are functions of the eigenvalues X. We accept (5.134) without proving 
it. The proof can be found in Linear Algebra and Matrix Theory textbooks. 

Since the coefficients a t are functions of the eigenvalues X , we must consider the following cases: 
Case I: Distinct Eigenvalues (Real or Complex) 

If X l ^X 2 ^X 3 ^... ^X n , that is, if all eigenvalues of a given matrix A are distinct, the 
coefficients a, are found from the simultaneous solution of the following system of equa¬ 
tions: 


2 

n — 1 

a 0 + + a 2 Aq 

.. + a n _ 1 A l = e 

a o + a.{k 2 + a 2 A 2 + .. 

, n-1 V 

.. + a n _jA 2 = e 

a 0 + + a 2 A< n * 

,n-l V 

.. +a n _jA n = e 


Example 5.16 

Compute the state transition matrix e At given that A 


Solution: 

We must first find the eigenvalues X of the given matrix A. These are found from the expansion 
of 


For this example, 


det[A-Al] = 0 


or 

Therefore, 


det | j" -2 1 

1-4 1 °T 

1 = det 2 - X 1 1 

ILo -i 

1 d 

1 L o -i-xj 


= (-2-X)(- 1 -X) = 0 

(A+l)(A + 2) = 0 
Xj = -1 and X 2 = -2 


(5.136) 


Next, we must find the coefficients a t of (5.134). Since A is a 2 x 2 matrix, we only need to con¬ 
sider the first two terms of that relation, that is, 
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e At = a 0 I + ajA 

The coefficients a„ and a 1 are found from (5.135). For this example, 


a 0 + a x X x = e 
a 0 + ajA -2 = e 


or 


a 0 -tad-1) = e~ 
ao + ad-2) = e” 2t 

Simultaneous solution of (5.138) yields 

n -t -2t 

a 0 = 2e -e 

-t -2t 

a x = e - e 

and by substitution into (5.137), 


or 


= (2e - e ) 


1 0 
0 1 


+ (e -e ) 




(5.137) 


(5.138) 


(5.139) 


(5.140) 


In summary, we compute the state transition matrix e At for a given matrix A using the following 
procedure: 

1. We find the eigenvalues X from det[A -XI] = 0. We can write [A - XI] at once by subtract¬ 
ing X from each of the main diagonal elements of A. If the dimension of A is a 2 x 2 matrix, 
it will yield two eigenvalues; if it is a 3 x 3 matrix, it will yield three eigenvalues, and so on. If 
the eigenvalues are distinct, we perform steps 2 through 4 below; otherwise we refer to Case 
II. 

2. If the dimension of A is a 2 x 2 matrix, we use only the first 2 terms of the right side of the 
state transition matrix 

e At = a 0 I + ajA + a 2 A 2 + ... + a n _ 1 A n “ 1 (5.141) 

If A matrix is a 3 x 3 matrix, we use the first 3 terms, and so on. 
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3. We obtain the a ; coefficients from 

slq + a^X j + a 2 X x + ... + a n _ ^X] 
ag + a 1 X 2 + a 2 X 2 + ... + a n _ ^X 2 

, ,2 -n-1 V 

a 0 + ajAn + a 2 X n + ... + a n _ jX n =e 

We use as many equations as the number of the eigenvalues, and we solve for the coefficients 

a i. 

4 . We substitute the a ; coefficients into the state transition matrix of (5.141), and we simplify. 


Xjt 

= e 

X 2 t 

= e 


Example 5.17 

Compute the state transition matrix e At given that 


Solution: 



7 -5 
4 -1 

8 -3 


(5.142) 


1. We first compute the eigenvalues from det[A - XI] = 0. We obtain [A - XI] at once, by sub¬ 
tracting X from each of the main diagonal elements of A. Then, 


5 -X 


det[A-Xl] = det 


0 

2 


7 

4 -X 

8 


-5 

-1 

- 3 - X 


and expansion of this determinant yields the polynomial 
X 3 -6X 2 + 11X-6 = 0 


We will use MATLAB roots(p) function to obtain the roots of (5.144). 

p= [1 -6 11 -6]; r=roots(p); fprinttf \n'); fprintf('lambda1 = %5.2f \t', r(1));... 
fprintf('lambda2 = %5.2f \t', r(2)); fprintf('lambda3 = %5.2f, r(3)) 

lambdal = 3.00 lambda2 = 2.00 lambda3 = 1.00 
and thus the eigenvalues are 


(5.143) 


(5.144) 
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A., = 1 A 2 = 2 A 3 = 3 


(5.145) 


2. Since A is a 3 x 3 matrix, we need to use the first 3 terms of (5.134), that is, 

e At = aJ + a^ + ajA 2 (5.146) 

3. We obtain the coefficients a 0 , a,, and a 2 from 

, ,2 V 

a 0 + a. A, + a 2 Aj = e 

1 ,2 M 

a 0 + a 1 A 2 + a 2 A 2 = e 

a 0 + a^j + a 2 A 2 = e* 3 
or 

a 0 + aj + a 2 = e 

a 0 + 2a!+4a 2 = e 2t (5.147) 

a 0 + 3a t + 9a 2 = e 3t 

We will use the following MATLAB script for the solution of (5.147). 

B=sym('[1 1 1;1 2 4; 1 3 9]'); b=sym('[exp(t); exp(2*t); exp(3*t)]'); a=B\b; fprintf('\n');... 
dispfaO = '); disp(a(1)); dispfal = '); disp(a(2)); disp('a2 = '); disp(a(3)) 

aO = 

3 * exp (t) - 3 * exp (2 * t) +exp (3 * t) 
al = 

-5/2*exp(t)+4*exp(2*t)-3/2*exp(3*t) 
a2 - 

l/2*exp(t)-exp(2*t)+l/2*exp(3*t) 


Thus, 


, = 3e - 3e + e 

5 t . 2t 3 3t 
i = - -e + 4e - -e 
1 2 2 

It 2t 1 3t 
! = 2 e “ e + 2 e 


(5.148) 


4 . We also use MATLAB to perform the substitution into the state transition matrix, and to per¬ 
form the matrix multiplications. The script is shown below. 

syms t; aO = 3*exp(t)+exp(3*t)-3*exp(2*t); al = -5/2*exp(t)-3/2*exp(3*t)+4*exp(2*t);... 
a2 = 1/2*exp(t)+1/2*exp(3*t)-exp(2*t);... 

A = [5 7 -5; 0 4 -1; 2 8 -3]; eAt=aO*eye(3)+a1 *A+a2*A A 2 
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eAt = 

[-2*exp(t)+2*exp(2*t)+exp(3*t),-6*exp(t)+5*exp(2*t)+exp(3*t), 

4*exp(t)-3*exp(2*t)-exp(3*t)] 

[-exp(t)+2*exp(2*t)-exp(3*t),-3*exp(t)+5*exp(2*t)-exp(3*t), 

2*exp(t)-3*exp(2*t)+exp(3*t)] 

[-3*exp(t)+4*exp(2*t)-exp(3*t),-9*exp(t) +10* exp(2*t)-exp(3*t), 

6 * exp(t)-6 * exp(2 * t)+exp(3 * t)] 

Thus, 

T t - 2t 3t , t , 2t , 3t . t - 2t 3t 

-2e +2e +e -6e + 5e +e 4e -3e -e 

e At = t _ 2t 3t . t , 2t 3t - t - 2t 3t 
-e +2e -e -3e +5e -e 2e -3e +e 

- 3e t + 4e 2t -e 3t -9e*+10e 2t -e 3t 6e t -6e 2t + e 3t 


Case II: Multiple Eigenvalues 

In this case, we will assume that the polynomial of 

det[A-Ai] = 0 (5.149) 

has n roots, and m of these roots are equal. In other words, the roots are 

A 1= A 2 = A 3 ... = A m , A m+1 , A n (5.150) 

The coefficients a i of the state transition matrix 

e At = a 0 I + ajA + a,A 2 + ... + a^A 11 ” 1 (5.151) 

are found from the simultaneous solution of the system of equations of (5.152) below. 


Example 5.18 

Compute the state transition matrix e At given that 

A 

Solution: 

1. We first find the eigenvalues A of the matrix A and these are found from the polynomial of 
det[A - AI] = 0 . For this example, 
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a 0 + a Ai + a 2^i + • • • + a n 

-XT 

i V 

= e 

^-(a 0 + a Ai + a 2^i + • • • + a n _ 

A ”" 1 

ii 

— 2 (slq + a A! + a 2 Aj + ... + a n _ 
dXj 

A ”" 1 

ii 

—--(a n + a.X, + a,A,? + ... + a„ 

dA” 

A ”" 1 

M 

^ l°g : 

- B f 

a 0 + aAm+l + a 2 A m+1 + ••• + a n 

-Am'J 

L X m + I t 

1 = e 

a 0 + a An + a 2^n + • • • + a n 

_ An" 

i V 

= e 


(5.152) 


det[A-Al] = detr 1_A u = 0 

I 2 -1-AJ 


= (-1-A)(-1-A) = 0 
= (A + l) 2 = 0 


and thus, 


Xj = A 2 = -1 

2. Since A is a 2 x 2 matrix, we only need the first two terms of the state transition matrix, that 


e = a 0 I + ajA 

3. We find a 0 and a x from (5.152). For this example, 

, V 

a o + a Al — e 

d , , , d 

dX 1 (a o + aiX i) " dXj 

or 

, M 

a o+ a Al — e 

a x = te 

and by substitution with X l = A 2 = -1 , we obtain 


(5.153) 
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a 0 - a i - e 
a j = te - 

Simultaneous solution of the last two equations yields 
a 0 = e t + te 1 
a L = te -t 

4 . By substitution of (5.154) into (5.153), we obtain 


= (e + te ) 


I 1 Ol+te-f 1 °] =e A ‘ = 

e * 0 

Lo 4 ]_2 -iJ 

_2te _t e -t _ 


(5.154) 


(5.155) 


We can use the MATLAB eig(x) function to find the eigenvalues of an n x n matrix. To find out 

how it is used, we invoke the help eig command. 

We will first use MATLAB to verify the values of the eigenvalues found in Examples 5.16 through 

5.18, and we will briefly discuss eigenvectors on the next section. 

For Example 5.16: 

A= [-2 1; 0 -1]; lambda=eig(A) 

lambda = 

-2 

-1 

For Example 5.17: 

B = [5 7 -5; 0 4 -1; 2 8 -3]; lambda=eig(B) 

lambda = 

1.0000 

3.0000 

2.0000 

For Example 5.18: 

C = [-1 0; 2 -1]; lambda=eig(C) 

lambda = 

-1 

-1 
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5.11 Eigenvectors 

Consider the relation 

AX = XX (5.156) 

where A is an n x n matrix, X is a column vector, and A, is a scalar number. We can express this 
relation in matrix form as 


We write (5.157) as 
or 


*21 “22 ••• “2n 


(A-XI)X = 0 


(a n -X)x l a 12 x 2 ... a ln x n 

a 21 X l ( a 22 - ^) X 2 a 2n X n 

a nl X l a n2 X 2 ••• ( a nn“^) X n 


(5.157) 


(5.158) 


(5.159) 


The equations of (5.159) will have non-trivial solutions if and only if its determinant is zero , that 
is, if 


( a n -X) a 12 ... a ln 


det 


a 21 ( a 22 '••• 


(5.160) 


a nl a n2 ”• ( a nn - ^) 


Expansion of the determinant of (5.160) results in a polynomial equation of degree n in X , and it 
is called the characteristic equation. 


We can express (5.160) in a compact form as 


det(A-Xl) = 0 


(5.161) 


As we know, the roots X of the characteristic equation are the eigenvalues of the matrix A, and 
corresponding to each eigenvalue X , there is a non-trivial solution of the column vector X, i.e., 


*. This is because we want the vector X in (5.158) to be a non—zero vector and the product (A-Al)X to be zero. 
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Eigenvectors 


X ^ 0. This vector X is called eigenvector. Obviously, there is a different eigenvector for each 
eigenvalue. Eigenvectors are generally expressed as unit eigenvectors, that is, they are normalized to 
unit length. This is done by dividing each component of the eigenvector by the square root of the 
sum of the squares of their components, so that the sum of the squares of their components is 
equal to unity. 

In many engineering applications the unit eigenvectors are chosen such that X • X T = I where 
X T is the transpose of the eigenvector X, and I is the identity matrix. 

Two vectors X and Y are said to be orthogonal if their inner (dot) product is zero. A set of eigen¬ 
vectors constitutes an orthonormal basis if the set is normalized (expressed as unit eigenvectors) 
and these vector are mutually orthogonal. An orthonormal basis can be formed with the Gram- 
Schmidt Orthogonalization Procedure; it is discussed in Chapter 14. 

The example which follows, illustrates the relationships between a matrix A, its eigenvalues, and 
eigenvectors. 


Example 5.19 
Given the matrix 


5 

0 

2 


a. Find the eigenvalues of A 

b. Find eigenvectors corresponding to each eigenvalue of A 

c. Form a set of unit eigenvectors using the eigenvectors of part (b). 

Solution: 

a. This is the same matrix as in Example 5.17, where we found the eigenvalues to be 


b. We begin with 
and we let 


Then, 


K = 1 ^2 = 2 X 3 = 3 


AX = XX 


x i 


x = X 2 


x 3 
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5 

0 

1 -5 

4 -1 

x i 

x 2 

= X 

X 1 

x 2 

2 

8 -3 

_ x 3_ 


x 3 


5x 3 

7x 2 

-5x 3 


LX! 

0 

4x 2 

— x 3 

= 

Xx 2 

2xj 

8x 2 

-3x 3 


Xx 3 


Equating corresponding rows and rearranging, we obtain 


(5-X)x l 

7x 2 

-5x 3 


0 

0 

(4-X)x 2 

—X 3 

= 

0 

2xj 

8x 2 

-(3 - X)x 3 


0 


For X = 1, (5.164) reduces to 

4xj + 7 x 2 - 5x 3 = 0 
3x 2 -x 3 = 0 
2x l + 8x 2 -4x 3 = 0 

By Crame’s rule, or MATLAB, we obtain the indeterminate values 
Xj = 0/0 x 2 = 0/0 x 3 = 0/0 


(5.162) 


(5.163) 


(5.164) 


(5.165) 


(5.166) 


Since the unknowns x l5 x 2 , and x 3 are scalars, we can assume that one of these, say x 2 , is 
known, and solve x 3 and x 3 in terms of x 2 . Then, we obtain x 3 = 2x 2 , and x 3 = 3x 2 . 


Therefore, an eigenvector for X = 1 is 


Xi 


2x 2 


2 


2 

X 2 

= 

X 2 

= x 2 

1 

= 

1 

X 3_ 


3x 2 


3_ 


3 


since any eigenvector is a scalar multiple of the last vector in (5.167). 

Similarly, for A, = 2 , we obtain Xj = x 2 , and x 3 = 2x 2 . Then, an eigenvector for X = 2 is 
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X 1 


x 2 


1 


1 

X X = 2= 

*2 

= 

X 2 

= X 2 

1 


1 (5.168) 


X 3 


2x 2 


2 


l 


Finally, for X = 3 , we obtain Xj = -x 2 , and x 3 = x 2 . Then, an eigenvector for X = 3 is 


(5.169) 


c. We find the unit eigenvectors by dividing the components of each vector by the square root of 
the sum of the squares of the components. These are: 


The unit eigenvectors are 


J2 2 + l 2 + 3 2 = Vl4 

Jl 2 +\ 2 + 2 2 = 76 

V(-i) 2 + i 2 + i 2 = 73 



2 


J_ 


-1 


7l4 


76 


73 

i = 

1 

714 

Unit X x = 2 = 

1 

76 

Unit _ 3 = 

1 

73 


3 


2 


1 


714 


_76_ 


_73_ 


We observe that for the first unit eigenvector the sum of the squares is unity, that is, 


(77 


(77 


(77 


= ± + L + ±=l 

14 14 14 


(5.170) 


(5.171) 


and the same is true for the other two unit eigenvectors in (5.170). 
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5.12 Summary 

• Differential equations are classified by: 

Type - Ordinary or Partial 

Order - The highest order derivative which is included in the differential equation 

Degree - The exponent of the highest power of the highest order derivative after the differen¬ 
tial equation has been cleared of any fractions or radicals in the dependent variable and its 
derivatives 

• If the dependent variable y is a function of only a single variable x, that is, if y = f(x) , the 
differential equation which relates y and x is said to be an ordinary differential equation and 
it is abbreviated as ODE. 

• If the dependent variable y is a function of two or more variables such as y = f (x, t), where x 
and t are independent variables, the differential equation that relates y, x, and t is said to be 
a partial differential equation and it is abbreviated as PDE. 

• A function y = f(x) is a solution of a differential equation if the latter is satisfied when y and 
its derivatives are replaced throughout by f(x) and its corresponding derivatives. Also, the 
initial conditions must be satisfied. 

• The ODE 


d n y 

t n —- + a 
dt n 


d 

! dt n 


dy , d m x . d™ x . dx . 

a l Hf + a ° Y = b m— +b m-l— TT + - +b lm +b 0 X 


is a non-homogeneous differential equation if the right side, known as forcing function, is not 
zero. If the forcing function is zero, the differential equation is referred to as homogeneous dif¬ 
ferential equation. 

• The most general solution of an homogeneous ODE is the linear combination 
y H (t) = ki Yi(t) + k 2 y 2 (t) + k 3 y 3 (t) + ... +k n y n (t) 


where the subscript H is used to denote homogeneous and k l5 k 2 , k 3 , ..., k n are arbitrary con¬ 
stants. 

• Generally, in engineering the solution of the homogeneous ODE, also known as the comple¬ 
mentary solution, is referred to as the natural response, and is denoted as y N (t) or simply y N . 
The particular solution of a non-homogeneous ODE is be referred to as the forced response, 
and is denoted as y F (t) or simply y F . The total solution of the non-homogeneous ODE is the 
summation of the natural and forces responses, that is, 
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y(t) = y Natural + y Forced = y N + y F 
Response Response 

The natural response y N contains arbitrary constants and these can be evaluated from the 
given initial conditions. The forced response y F , however, contains no arbitrary constants. It is 
imperative to remember that the arbitrary constants of the natural response must be evaluated 
from the total response. 

• For an nth order homogeneous differential equation the solutions are 

yi = k ie Slt , y 2 = k 2 e S2t , y 3 = k^ 3 *, ..., y n = k n e Sn ‘ 
where s l5 s 2 ,..., s n are the solutions of the characteristic equation 
a n s n + a n _ j s n 1 + ... + aj s + a 0 =0 
and a n , a n _ 1; ..., a t , a 0 are the constant coefficients of the ODE 

• If the roots of the characteristic equation are distinct, the n solutions of the natural response 
are independent and the most general solution is: 

y N = kie Slt + k 2 e S 2 t +...+k n e Snt 

• If the solution of the characteristic equation contains m equal roots, the most general solution 
has the form: 

y N = (ki +k 2 t+ ... +k m t m_1 )e ‘ +k n _ ; e S 2 t +...+k n e Snt 

• If the characteristic equation contains complex roots, these occur as complex conjugate pairs. 
Thus, if one root is s t = -oc+jP where a and P are real numbers, then another root is 
s 2 = -a-jp. Then, for two complex conjugate roots we evaluate the constants from the 
expressions 

k t e 1 +k 2 e 2 = e at (k 3 cosPt + k 4 sinPt)= e at k 5 cos(Pt + (p) 

• The forced response of a non-homogeneous ODE can be found by the method of undeter¬ 
mined coefficients or the method of variation of parameters. 

• With the method of undetermined coefficients, the forced response is a function similar to the 
right side of the non-homogeneous ODE. The form of the forced response for second order 
non-homogeneous ODEs is given in Table 5.1. 

• In certain non-homogeneous ODEs, the right side f(t) cannot be determined by the method 
of undetermined coefficients. For these ODEs we must use the method of variation of parame- 
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ters. This method will work with all linear equations including those with variable coefficients 
provided that the general form of the natural response is known. 

• For second order ODEs with constant coefficients, the method of variation of parameters 
replaces the constants kj and k 2 by two variables u, and u 2 that satisfy the following three 
relations: 

y = Uj Yi + % y 2 


du, du 2 
df y i + y 2 = 0 


dt J 


4 . ^ ^2 _ .. . 

dt dt dt dt 

Simultaneous solution of last two expressions above will yield the values of du, /dt and 
du 2 /dt; then, integration of these will produce Uj and u 2 , which when substituted into the 
first will yield the total solution. 

• An nth-order differential equation can be resolved to n first-order simultaneous differential 
equations with a set of auxiliary variables called state variables. The resulting first-order differ¬ 
ential equations are called state space equations, or simply state equations. 

• The state representation of a system can be described by the pair of the of the state space 
equations 

x = Ax + bu 
y = Cx + du 

• In a system of state equations of the form 

x = ax + |3u 
y = kjX + k 2 u 

where a, (3, k,, and k 2 are scalar constants, and the initial condition, if non-zero is denoted 
as x 0 = x(t 0 ), the solution of the first state equation above is 


x(t) = e a(t to) x 0 + e at j e aT pu(x)dT 

• In a system of state equations of the form 

x - Ax + bu 
y = Cx + du 
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where for two or more simultaneous differential equations A and C are 2 x 2 or higher order 
matrices, and b and d are column vectors with two or more rows, the solution of the matrix 
differential equation x = Ax + bu with initial conditions x(t 0 ) = x 0 is obtained from the 
relation 

A(t-t 0 ) At A -At, , , , 
x(t) = e x 0 + e e bu(x)dx 
% 

where the state transition matrix e At is defined as the matrix power series 

(p(t) = e At = I + At + ^aV + ^-A 3 t 3 + ... + ^-A n t n 
2! 3! n! 

and I is the n x n identity matrix. 

• If A is an n x n matrix, and I be the n x n identity matrix, the eigenvalues Xj, i = 1, 2, n of 
A are the roots of the nth order polynomial 

det[A-Xl] = 0 

• Evaluation of the state transition matrix e At is based on the Cayley-Hamilton theorem. This 
theorem states that a matrix can be expressed as an (n - 1 )th degree polynomial in terms of the 
matrix A as 

At T . .2 . n — 1 

e = a 0 I + a 1 A + a 2 A + ...+a n _ 1 A 

where the coefficients a ; are functions of the eigenvalues X . 

• If ^ X 2 * X 3 + ... ± X n , that is, if all eigenvalues of a given matrix A are distinct, the coeffi¬ 
cients a ; are found from the simultaneous solution of the following system of equations: 

a 0 + a^! + a 2 X 2 + ... + a n _ jX” 1 = e 1 
a 0 + a t X 2 + a 2 X 2 + ... + a n _jX 2 -1 = e 2 

a 0 + a^n + a 2 A, 2 + ... + a n _ 1 = e 

• If the polynomial of det[A-A,I] = 0 has n roots, and m of these roots are equal, that is, if 
Xj = X 2 = X 3 ... = X m , X m+ j , X n , the coefficients a ; of the state transition matrix 

e At = a 0 I + a 1 A + a 2 A 2 + ...+a nM A n ' 1 
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are found from the simultaneous solution of the system of equations below. 

a 0 + + a 2 Xj + ... + a n _ 1 X”‘ 1 = e^ 1 * 

d , , ,2 ,n-l. d M 

s -(a, + a,X, + a 2 X l + ... + a„.,X l ) = 

d“ , , » 2 ,n-l, d M 

- ; (a 0 + a,X 1 + aA + ... + a„. 1 X 1 ) - ^ 

—j (cto + 3 \X\ + 3.2 X i + ...+a n _iA-i ) 

dX™~ 

a 0 + a l^m+l + a 2^m + 1 + ••• + a n-l^m+ 1 

a 0 + aA n + a 2 Lji+... + a n _A” _1 = e A “ 

• We can use the MATLAB eig(x) function to find the eigenvalues of an n x n matrix. 

• If A is an n x n matrix, X is a non-zero column vector, and A, is a scalar number, the vector 
X is called eigenvector. Obviously, there is a different eigenvector for each eigenvalue. Eigen¬ 
vectors are generally expressed as unit eigenvectors, that is, they are normalized to unit length. 
This is done by dividing each component of the eigenvector by the square root of the sum of 
the squares of their components, so that the sum of the squares of their components is equal to 
unity. 
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5.13 Exercises 

Solve the following ODEs by any method and verify your answers with MATLAB. 

1. dV + 4^ + 3y = t-l 

dt 2 dt 

2. + 4^ + 3y = 4e _t 
dt 2 dt 

3. ^-^ + 2^ + y = cos 2 t Hint: Use cos 2 t = ^(cos2t+l) 

dt 2 dt 2 

4. + y = sect 
dt 2 

5 Express the integro-differential equation below as a matrix of state equations where 
kj, k 2 , and k 3 are constants. 


+ k 3 ^ + k 2 v + kj f vdt = sin3t+cos3t 
dt 2 dt J o 

6 . Express the matrix of the state equations below as a single differential equation, and let 
x(y) = y(t). 


7. 


*1 


0 

1 

0 0 


*i 


0 

X 2 

_ 

0 

0 

1 0 


x 2 

+ 

0 

x 3 


0 

0 

0 1 


X 3 


0 

x 4 


-1 

-2 

-3 -4 


x 4 


1 


Compute the eigenvalues of the matrices A, B , and C below. 


u(t) 



Hint: One of the eigenvalues of matrix C is - 1 . 
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8. Compute e At given that 

0 1 0 
A = 0 0 1 
-6 -11 -6 
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5.14 Solutions to End-of-Chapter Exercises 

1. The characteristic equation of the homogeneous part is s 2 + 4s + 3 = 0 from which Sj = -1 
and s 2 = —3 . Thus y N = kje _t + k 2 e~ 3t . For the forced response, we refer to Table 5.1 and we 
assume a solution of the form y F = k 3 t + k 4 and the total solution is 

y = kje - * + k 2 e _3t + k 3 t + k 4 
The first and second derivatives of y are 

dy/dt = - kje _t -3k 2 e^ 3t + k 3 
d 2 y/dt 2 = k t e -t + 9k 2 e _3t 
and by substitution into the given ODE 

kje -1 + 9k 2 e _3t + 4(-k 1 e _t -3k 2 e _3t + k 3 ) + 3(kje _t + k 2 e _3t + k 3 t + k 4 ) = t-1 
Equating like terms we obtain 

4k 3 + 3k 3 t + 3k 4 = t- 1 
3k 3 t = t 
4k 3 + 3k 4 = -1 

and simultaneous solution of the last two yields k 3 = 1/3 and k 4 = -7/9 . Therefore, 
y = k,e-' + k 2 e- 3, + i t -| 

Check with MATLAB: 

y=dsolve('D2y+4*Dy+3*y=t-1 ’); y=simple(y) 

Y = 

-7/9+l/3*t+Cl/exp(t)+C2/exp(t) A 3 

2. The characteristic equation of the homogeneous part is the same as for Exercise 1 and thus 
y N = kj e _t + k 2 e _3t . For the forced response, we refer to Table 5.1 and we assume a solution of 
the form y F = k 3 te _t where we multiplied e~ l by t to avoid the duplication with kje -1 . By sub¬ 
stitution of this assumed solution into the given ODE and using MATLAB to find the first and 
second derivatives we obtain: 

y = kje 1 + k 2 e _3t + k 3 te _t 
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We will use MATLAB to find the first and second derivatives of this expression. 

syms t k3 % Define symbolic variables 

y0=k3*t*exp(-t); % Assumed form of total solution 

yl =diff(yO); fl =simple(y1) % Compute and simplify first derivative 

fl = 

-k3*exp(-t)*(-1+t) 

Thus, the first derivative of y F is 

dy F /dt = k 3 e _t -k 3 te _t 

y2=diff(y0,2); f2=simple(y2) % Compute and simplify second derivative 

f 2 - 

k3*exp(—t)*(-2+t) 
and the second derivative of y is 


d 2 yp/dt 2 = -2k 3 e l + k 3 te’ 


f=y2+4*y1+3*y0; f=simple(f) % Form and simplify the left side of the given ODE 

f = 

2*k3/exp(t) 

and by substitution into the given ODE 

2k 3 e _t = 4e -t 


or k 3 = 2. Therefore, 


Check with MATLAB: 


y = kje 1 + k 2 e 3t + 2te" 


y=dsolve('D2y+4*Dy+3*y=4*exp(-t)'); y=simple(y) 

2*t/exp(t)-1/exp(t)+Cl/exp(t)+C2/exp(t) A 3 

We observe that the second and third terms of the displayed expression above have the same 
form and thus they can be combined to form a single term C3 / exp (t) . 

3. The characteristic equation yields two equal roots Sj = s 2 = -1 and thus the natural response 
has the form 

y N = kje l + k 2 te 1 

For the forced response we assume a solution of the form 
y F = k 3 cos2t + k 4 sin2t + k 5 
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We will use MATLAB to find the first and second derivatives of this expression. 

syms t kl k2 k3 k4 k5 % Define symbolic variables 

y0=k3*cos(2*t)+k4*sin(2*t)+k5; % Assumed form of total solution 

y1=diff(y0); f1=simple(y1) % Compute and simplify first derivative 

fl = 

-2*k3*sin(2*t)+2*k4*cos(2*t) 

Thus, the first derivative of y F is 

dyp/dt = -2k 3 sin2t + 2k 4 cos2t 

y2=diff(y0,2); f2=simple(y2) % Compute and simplify second derivative 

f 2 = 

-4*k3*cos(2*t)-4*k4*sin(2*t) 
and the second derivative of y is 

d 2 yp/dt 2 = -4k 3 cos 2t-4k 4 sin2t 

f=y2+2*y1+y0; f=simple(f) % Form and simplify the left side of the given ODE 

f = 

-3*k3*cos(2*t)-3*k4*sin(2*t)-4*k3*sin(2*t)+4*k4*cos(2*t)+k5 
Simplifying this expression and equating with the right side of the given ODE we obtain: 

(-3k 3 + 4k 4 )cos2t-(4k 3 + 3k 4 )sin2t + k 5 = co ^ t + ^ 

Equating like terms and solving for the k terms we obtain 
-3k 3 + 4k 4 = 1/2 
- 4k 3 - 3k 4 = 0 

k 5 = 1/2 

Simultaneous solution of the first two equations above yields k 3 = -3/50 and k 4 = 4/50. 
Therefore, the forced response is 

y F = (-3/50)cos2t + (4/50)sin2t + 1/2 

and the total response is 

y = k|e- , + k 2 te-' + t- 3cos2t - 4sin2t 
y 1 2 2 50 

Check with MATLAB: 
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y=dsolve('D2y+2*Dy+y=cos(2*t)/2+1/2'); f=simple(y) 

f - 

-3/50*cos(2*t)+2/25*sin(2*t)+l/2+Cl*exp(-t)+C2*exp(-t)*t 

4. It is very difficult, if not impossible, to assume a solution for the forced response of this ODE. 
Therefore, we will use the method of variation of parameters. 

The characteristic equation is s +1 =0 from which s = ±j and thus the natural response is 



We let 


yj = cost and y 2 = sint 


Then, by (5.68) the solution is 


y = UjYj + u 2 y 2 = u x cost + u 2 sint (1) 


Also, from (5.69), 



or 



and from (5.70), 


duj dyj du 2 
dt dt + dt 



Next, we find duj/dt and du 2 /dt by Cramer’s rule as follows: 


I 0 sint I 
dU] _ [sect cost) 



sint 


dt I cost sint 


|—sint cost] 


and 


I cost 0 


du 2 _ |—sint _ sect) 

dt " 1 


1 ( 3 ) 


Integration of (2) and (3) above and substitution into (1) yields 

u x = j(-tant)dt = - (-Incost) + fq = lncost + lq 
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y = UjYj + u 2 y 2 = (In cost + k^cost + (t + k 2 )sint 
= kjcost + k,sint + tsint + cost(lncost) 

Check with MATLAB: 
y=dsolve('D2y+y=sec(t)'); f=simple(y) 
f = 

sin(t)*t+log(cos(t))*cos(t)+Cl*sin(t)+C2*cos(t) 

5. Differentiating the given integro-differential equation with respect to t we obtain 


We let 


Then, 


Mt 2 2 dt 

dv 
dt 


dv 

dt 2 


and by substitution into (1) 

x 3 = -kjXj-k 2 x 2 -k 3 x 3 + 3(cos3t-sin3t) 

Thus, the state equations are 


and in matrix form 


A 2 - A 3 

x 3 = -kjXj -k 2 x 2 -k 3 x 3 + 3(cos3t- sin3t) 


0 • 3(cos3t- sin3t) 






X 1 


0 1 0 


x i 


0 

x 2 

= 

0 0 1 


x 2 

+ 

0 



-kj -k 2 -k 3 


x 


1 

x 3 




L i 
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6 . Expansion of the given matrix yields 


Xj = x 2 x 2 = x 3 x 3 = x 2 x 4 = -Xj -2x 2 - 3x 3 -4x 4 + u(t) 


Letting x = y we obtain 


7. 


d5L + 4 ^ + 3 ^ + 2^ 

dt 4 dt dt 


+ y = u(t) 


a= E j] det<A - xi) = de ([L']- x [o H= det [ i 3 x -i-J=° 

(1 - A,)(- 1 — A,) — 6 = 0 , - 1 -X + X + X 2 -6 = 0,X 2 = 7, and thus ^ = Jl X 2 = -Jl 
b. 

B ■ [-1 °J de,(B - XI) ■ de {[-l Ho I* de fc A b-J ■ ° 

(a-X)(b-A) = 0 , and thus Xj = a X 2 = b 


0 1 0 


0 1 0 


r A 

1 0 0 

0 0 1 

det(C-M) = det 

0 0 1 

-X 

0 1 0 

-6 -11 -6 


-6 -11 -6 


0 0 1 , 


= det 


-X 

0 

-6 


1 

-X 

-11 


0 

1 =0 
-6-X 


A, 2 (— 6 —A-) — 6 — (—11 )(—A,) = X 3 + 6 V + llA, + 6 = 0 and it is given that X , 1 = - 1 . Then, 

X 3 + 6X +ia + 6 = X 2 + 5X + 6^(X+ l)(X + 2)(X + 3) = 0 

(A+ 1) 

and thus Aj = -1 X 2 = -2 Xj = -3 


8 . 

a. Matrix A is the same as Matrix C in Exercise 7. Then, 

An = -1 ^2 = -2 = -3 
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and since A is a 3 x 3 matrix the state transition matrix is 


Then, 


e At = a 0 I + a 1 A + a 2 A 2 (1) 

, ,2 M -t 

a 0 + ajAj + a 2 A, = e => a 0 - a l + a 2 = e 

a 0 + ajA 2 + a 2 A 2 = => a 0 - 2a l + 4a 2 = e" 

a 0 + a, A 3 + a 2 A 3 = e^ 3 * => a 0 - 3a } + 9a 2 = e 


syms t; A=[1 -1 1;1 -2 4; 1 -3 9];... 

a=sym('[exp(-t); exp(-2*t); exp(-3*t)]'); x=A\a; fprintf(' \n');... 

disp('aO = '); disp(x(1)); disp('a1 = '); disp(x(2)); disp('a2 = '); disp(x(3)) 


aO = 

3*exp(-t)-3*exp(-2*t)+exp(-3*t) 
al = 

5/2*exp(-t)-4*exp(-2*t)+3/2*exp(-3*t) 
a2 = 

l/2*exp(-t)-exp(-2*t)+l/2*exp(-3*t) 
Thus, 

a 0 = 3e _t -3e _2t + 3e _3t 
aj = 2.5e _t -4e _ 2 t +1.5e _3t 


a 2 = 0.5e l -e 2t + 0.5e 3t 


Now, we compute e At of (1) with the following MATLAB code: 

syms t; a0=3*exp(-t)-3*exp(-2*t)+exp(-3*t); al =5/2*exp(-t)-4*exp(-2*t)+3/2*exp(-3*t);... 
a2=1 /2*exp(-t)-exp(—2*t) +1 /2*exp(—3*t); A=[0 1 0; 0 0 1; -6-11 -6]; fprintff \n');... 
eAt=aO*eye(3)+a1 *A+a2*A A 2 

eAt = 

[3*exp(-t)-3*exp(-2*t)+exp(-3*t), 5/2*exp(-t)-4*exp(-2*t)+3/ 
2 * exp(-3 * t), 1/2 * exp(-1)-exp(-2*t)+l/2*exp(-3*t)] 

[-3*exp(-t)+6*exp(-2*t)-3*exp(-3*t), -5/2*exp(-t)+8*exp(- 
2 *t)-9/2*exp(—3 * t), -l/2*exp(-t)+2*exp(—2 * t)-3/2*exp(— 3 * t)] 
[3*exp(—t)-12*exp(—2 * t)+9*exp(— 3 * t), 5/2*exp(—t)-16*exp(- 
2*t)+27/2*exp(— 3 * t), l/2*exp(-t)-4*exp(-2*t)+9/2*exp(- 

3*t) ] 

Then, 
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~ -t - -2t -3t 

3e -3e +e 

- -t , -2t _ -3t 

-3e + 6e -3e 
3e _t -12e" 2t + 9e" 3t 


2.5e l -4e 2t + 1.5e 3t 
-2.5e _t +8e" 2t -4.5e“ 3t 
2.5e"‘- 16e 2t + 13.5e -3 * 


0.5e *- e 2t + 0.5e 3t 
-0.5e _t + 2e“ 2t -1.5e" 3t 
0.5e _t -4e" 2t + 4.5e" 3t 
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Chapter 6 


Fourier, Taylor, and M aclaurin Series 


T his chapter is an introduction to Fourier and power series. We begin with the definition of 
sinusoids that are harmonically related and the procedure for determining the coefficients of 
the trigonometric form of the series. Then, we discuss the different types of symmetry and 
how they can be used to predict the terms that may be present. Several examples are presented to 
illustrate the approach. The alternate trigonometric and the exponential forms are also presented. 
We conclude with a discussion on power series expansion with the Taylor and Maclaurin series. 


6.1 Wave Analysis 

The French mathematician Fourier found that any periodic waveform, that is, a waveform that 
repeats itself after some time, can be expressed as a series of harmonically related sinusoids, i.e., 
sinusoids whose frequencies are multiples of a fundamental frequency (or first harmonic). For 
example, a series of sinusoids with frequencies 1 MHz , 2 MHz , 3 MHz , and so on, contains the 
fundamental frequency of 1 MHz , a second harmonic of 2 MHz , a third harmonic of 3 MHz, 
and so on. In general, any periodic waveform f(t) can be expressed as 


or 


+ tqsincot + b 2 sin2cot + b 3 sin3cot + b 4 sin4cot + ... 


( 6 . 1 ) 


f(t) = ^a 0 + 


^ (a n cosncot + b n sinncot) 


( 6 . 2 ) 


where the first term a 0 /2 is a constant, and represents the DC (average) component of f(t). 
Thus, if f(t) represents some voltage v(t), or current i(t), the term a 0 /2 is the average value of 
v(t) or i(t). 


The terms with the coefficients a! and b, together, represent the fundamental frequency compo¬ 
nent to . Likewise, the terms with the coefficients a 2 and b 2 together, represent the second har¬ 
monic component 2 co, and so on. 


* We recall that kjcoscot + k 2 sincot = kcos(cot + 0) where 0 is a constant. 
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Since any periodic waveform f(t) can be expressed as a Fourier series, it follows that the sum of 
the DC, the fundamental, the second harmonic, and so on, must produce the waveform f(t). 
Generally, the sum of two or more sinusoids of different frequencies produce a waveform that is 
not a sinusoid as shown in Figure 6.1. 


2nd Harmonic 



Figure 6.1. Summation of a fundamental, second and third harmonic 

6.2 Evaluation of the Coefficients 

Evaluations of a ; and b ; coefficients of (6.1) is not a difficult task because the sine and cosine are 
orthogonal functions, that is, the product of the sine and cosine functions under the integral evalu¬ 
ated from 0 to 27t is zero. This will be shown shortly. 


Let us consider the functions sinmt and cosmt where m and 
nience, we have assumed that to = 1. Then, 

n are any integers, and for conve- 

r 2n 


sinmtdt = 0 

J o 

(6.3) 

r 2n 


cosmtdt = 0 

J o 

(6.4) 

27! 


(sinmt) (cos nt)dt = 0 

J o 

(6.5) 

The integrals of (6.3) and (6.4) are zero since the net area over 

the 0 to 27t area is zero. The inte- 


gral of (6.5) is also is zero since 
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sinxcosy = |[sin(x + y) + sin(x-y)] 

This is also obvious from the plot of Figure 6.2, where we observe that the net shaded area above 
and below the time axis is zero. 


smx • cosx 



2n 

Figure 6.2. Graphical proof of (sinmt)(cosnt)dt = 0 

J o 

Moreover, if m and n are different integers, then, 

2n 

(sinmt)(sinnt)dt = 0 (6.6) 

J o 

since 

(sinx)(siny) = |[cos(x - y) - cos(x - y)] 

The integral of (6.6) can also be confirmed graphically as shown in Figure 6.3, where m = 2 and 
n = 3 . We observe that the net shaded area above and below the time axis is zero. 
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2n 

Figure 6.3. Graphical proof of (sinmt)(sinnt)dt = 0 for m = 2 and n = 3 

J o 


Also, if m and n are different integers, then, 


f 

(cosmt)(cosnt)dt = 0 

J o 

since 

(cosx)(cosy) = |[cos(x + y) + cos(x-y)] 


(6.7) 


The integral of (6.7) can also be confirmed graphically as shown in Figure 6.4, where m = 2 and 
n = 3 . We observe that the net shaded area above and below the time axis is zero. 



However, if in (6.6) and (6.7), m = n, then, 


and 


f z 1 2 

(sinmt) dt = n 
J o 


f A 1 2 

(cosmt) dt = n 

J o 


( 6 . 8 ) 

(6.9) 


The integrals of (6.8) and (6.9) can also be seen to be true graphically with the plots of Figures 6.5 
and 6.6. 

It was stated earlier that the sine and cosine functions are orthogonal to each other. The simpli- 


* We will discuss orthogonal functions in Chapter 14 


6-4 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 







Evaluation of the Coefficients 


fication obtained by application of the orthogonality properties of the sine and cosine functions, 
becomes apparent in the discussion that follows. 



r zn 2 

Figure 6.5. Graphical proof of (sinmt) dt = n 

J o 



.2n 2 

Figure 6.6. Graphical proof of (cosmt) dt = n 

J o 


In (6.1), for simplicity, we let to = 1. Then, 

f(t) = |a 0 + a 1 cost + a 2 cos2t + a 3 cos3t + a 4 cos4t+... 

+ bjsint + b 2 sin2t + b 3 sin3t + b 4 sin4t + ... 

To evaluate any coefficient, say b 2 , we multiply both sides of (6.10) by sin2t. Then, 


( 6 . 10 ) 


f(t)sin2t = |a 0 sin2t + a^ostsk^t + a 2 cos2tsin2t + a 3 cos3tsin2t + a 4 cos4tsin2t + ... 
b 1 sintsin2t + b 2 (sin2t) 2 + b 3 sin3tsin2t + b 4 sin4tsin2t + ... 
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Next, we multiply both sides of the above expression by dt, and we integrate over the period 0 to 
271. Then, 


f f(t)sin2tdt = ^a 0 f sin2tdt + a 1 [ costsin2tdt + a 2 f cos2tsin2tdt 
J o 2 J o J o J o 

2n 2n 

+ a 3 cos3tsin2tdt + a 4 cos4tsin2tdt + ... 

' o " o 

+ b 1 [ sintsin2tdt + b 2 [ (sin2t) 2 dt + b 3 f sin3tsin2tdt 
J o " J o J o 

2n 

+ b 4 sin4tsin2tdt + ... 

J o 

We observe that every term on the right side of (6.11) except the term 

2n 

bj (sin2t) 2 dt 

J o 

is zero as we found in ( 6 . 6 ) and (6.7). Therefore, (6.11) reduces to 

2n 2n 

j f(t)sin2tdt = b 2 j (sin2t) 2 dt = b 2 7t 


( 6 . 11 ) 


1 (.231 

b 2 = -1 f(t)sin2tdt 
7lJ n 


and thus we can evaluate this integral for any given function f(t). The remaining coefficients can 
be evaluated similarly. 

The coefficients a 0 , a n , and b n are found from the following relations. 



1 f 2n 

a = - f(t)cosntdt 
71J Q 


1 r 2n 

b n = - f(t)sinntdt 
7tJ 0 


( 6 . 12 ) 

(6.13) 


(6.14) 
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The integral of (6.12) yields the average (DC) value of f(t). 


6.3 Symmetry 

With a few exceptions such as the waveform of Example 6.6, the most common waveforms used 
in science and engineering, do not have the average, cosine, and sine terms all present. Some 
waveforms have cosine terms only, while others have sine terms only. Still other waveforms have 
or have not DC components. Fortunately, it is possible to predict which terms will be present in 
the trigonometric Fourier series, by observing whether or not the given waveform possesses some 
kind of symmetry. 

We will discuss three types of symmetry that can be used to facilitate the computation of the trig¬ 
onometric Fourier series form. These are: 

1. Odd symmetry - If a waveform has odd symmetry, that is, if it is an odd function, the series will 
consist of sine terms only. In other words, if f(t) is an odd function, all the a ; coefficients 
including a 0 , will be zero. 

2. Even symmetry - If a waveform has even symmetry, that is, if it is an even function, the series 
will consist of cosine terms only, and a 0 may or may not be zero. In other words, if f(t) is an 
even function, all the b ; coefficients will be zero. 

3. Half-wave symmetry - If a waveform has half-wave symmetry (to be defined shortly), only odd 
(odd cosine and odd sine) harmonics will be present. In other words, all even (even cosine and 
even sine) harmonics will be zero. 

We will now define even and odd functions and we should remember that even functions have 
nothing to do with even harmonics, and odd functions have nothing to do with odd harmonics. 

A function f(t) is an even function of time if the following relation holds. 


| f(-t) - f(t) | (6.15) 

that is, if in an even function we replace t with -t, the function f(t) does not change. Thus, 
polynomials with even exponents only, and with or without constants, are even functions. For 
instance, the cosine function is an even function because it can be written as the power series 


Other examples of even functions are shown in Figure 6.7. 


* We will discuss power series later in this chapter. 
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Figure 6.7. Examples of even functions 


A function f(t) is an odd function of time if the following relation holds. 


-f(-t) = f(t) 


(6.16) 


that is, if in an odd function we replace t with -t, we obtain the negative of the function f(t). 
Thus, polynomials with odd exponents only, and no constants are odd functions. For instance, 
the sine function is an odd function because it can be written as the power series 


Other examples of odd functions are shown in Figure 6.8. 


f(t) f(t) 



t 3 



Figure 6.8. Examples of odd functions 


We observe that for odd functions, f(0) = 0. However, the reverse is not always true; that is, if 
f(0) = 0, we should not conclude that f(t) is an odd function. An example of this is the function 
f(t) = t 2 in Figure 6.7. 

The product of two even or two odd functions is an even function, and the product of an even 
function times an odd function, is an odd function. 


Henceforth, we will denote an even function with the subscript e, and an odd function with the 
subscript o. Thus, f e (t) and f 0 (t) will be used to represent even and odd functions of time 
respectively. 


Also, 


f T f e (t)dt = 2[ T f e (t)dt 

-T J 0 


(6.17) 
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and 



(6.18) 


A function f(t) that is neither even nor odd can be expressed as 


f e (t) = ±[f(t) + f(-t)] 


(6.19) 


or as 


f 0 (t) = |[f(t)-f(-t)] 


( 6 . 20 ) 


By addition of (6.16) with (6.17), we get 


f(t) = f e (t) + f 0 (t) 


( 6 . 21 ) 


that is, any function of time can be expressed as the sum of an even and an odd function. 

To understand half-wave symmetry, we recall that any periodic function with period T, is 
expressed as 


( 6 . 22 ) 


f(t) = f(t + T) 


that is, the function with value f(t) at any time t , will have the same value again at a later time 
t + T. 

A periodic waveform with period T, has half-wave symmetry if 


-f (t + T/2) = f(t) 


(6.23) 


that is, the shape of the negative half-cycle of the waveform is the same as that of the positive 
half-cycle, but inverted. 

We will test the waveforms of Figures 6.9 through 6.13 for any of the three types of symmetry. 

1. Square waveform 

For the waveform of Figure 6.9, the average value over one period T is zero, and therefore, 
a 0 = 0. It is also an odd function and has half-wave symmetry since -f(-t) = f(t) and 
-f (t + T/2) = f(t). 
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An easy method to test for half-wave symmetry is to choose any half-period T/2 length on the 
time axis as shown in Figure 6.9, and observe the values of f(t) at the left and right points on the 
time axis, such as f(a) and f(b). If there is half-wave symmetry, these will always be equal but 
will have opposite signs as we slide the half-period T/2 length to the left or to the right on the 
time axis at non-zero values of f(t). 

2. Square waveform with ordinate axis shifted 

If we shift the ordinate axis ji/2 radians to the right, as shown in Figure 6.10, we see that the 
square waveform now becomes an even function and has half-wave symmetry since f(-t) = f(t) 
and -f (t + T/2) = f(t). Also, a 0 = 0. 



Figure 6.10. Square waveform, with ordinate shifted by n/2 


Obviously, if the ordinate axis is shifted by any other value other than an odd multiple of n/2 , 
the waveform will have neither odd nor even symmetry. 

3. Sawtooth waveform 

For the sawtooth waveform of Figure 6.11, the average value over one period T is zero and there¬ 
fore, a 0 = 0. It is also an odd function because —f(—t) = f(t), but has no half-wave symmetry 
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since -f (t + T/2) * f(t) 



Figure 6.11. Sawtooth waveform test for symmetry 


4. Triangular waveform 

For this triangular waveform of Figure 6.12, the average value over one period T is zero and 
therefore, a 0 = 0. It is also an odd function since —f(—t) = f(t). Moreover, it has half-wave sym¬ 
metry because -f (t + T/2) = f(t) 



5. Fundamental, Second and Third Harmonics of a Sinusoid 

Figure 6.13 shows a fundamental, second, and third harmonic of a typical sinewave where the 
half period T/2, is chosen as the half period of the period of the fundamental frequency. This is 
necessary in order to test the fundamental, second, and third harmonics for half-wave symmetry. 
The fundamental has half-wave symmetry since the a and -a values, when separated by T/2, 
are equal and opposite. The second harmonic has no half-wave symmetry because the ordinates 
b on the left and b on the right, although are equal, there are not opposite in sign. The third 
harmonic has half-wave symmetry since the c and -c values, when separated by T/2 are equal 
and opposite. These waveforms can be either odd or even depending on the position of the ordi¬ 
nate. Also, all three waveforms have zero average value unless the abscissa axis is shifted up or 
down. 
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3rd harmonic 



Figure 6.13. Fundamental, second, and third harmonic test for symmetry 

In the expressions of the integrals in (6.12) through (6.14), Page 6-6, the limits of integration for 
the coefficients a n and b n are given as 0 to 2 ji , that is, one period T. Of course, we can choose 
the limits of integration as -n to +n . Also, if the given waveform is an odd function, or an even 
function, or has half-wave symmetry, we can compute the non-zero coefficients a n and b n by 
integrating from 0 to n only, and multiply the integral by 2. Moreover, if the waveform has half¬ 
wave symmetry and is also an odd or an even function, we can choose the limits of integration 
from 0 to n/2 and multiply the integral by 4. The proof is based on the fact that, the product of 
two even functions is another even function, and also that the product of two odd functions 
results also in an even function. However, it is important to remember that when using these 
shortcuts, we must evaluate the coefficients a n and b n for the integer values of n that will result 
in non-zero coefficients. This point will be illustrated in Example 6.2. 


6.4 Waveforms in Trigonometric Form of Fourier Series 

We will now derive the trigonometric Fourier series of the most common periodic waveforms. 


Example 6.1 

Compute the trigonometric Fourier series of the square waveform of Figure 6.14. 
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Solution: 

The trigonometric series will consist of sine terms only because, as we already know, this wave¬ 
form is an odd function. Moreover, only odd harmonics will be present since this waveform has 
half-wave symmetry. However, we will compute all coefficients to verify this. Also, for brevity, 
we will assume that to = 1. 


The a, coefficients are found from 


a n = - I* f(t)cosntdt = - \ f Acosntdt+ f (-A)cosntdt 1= — (sinnt|!J- sinnt| 2lt ) 

71 » q 71 |_J q J ^ _| Ml ^ 

A A 

= — (sinmi - 0 - sinn27i + sinn7i) = — (2sinn7i - sinn27i) 
nn nn 


(6.24) 


and since n is an integer (positive or negative) or zero, the terms inside the parentheses on the 
second line of (6.24) are zero and therefore, all a; coefficients are zero, as expected, since the 
square waveform has odd symmetry. Also, by inspection, the average (DC) value is zero, but if 
we attempt to verify this using (6.24), we will get the indeterminate form 0/0. To work around 
this problem, we will evaluate a 0 directly from (6.12). Then, 


a o 


Adt + J "(-A)dtJ= ^(7I-0-2 ji + ji) = 0 


(6.25) 


The bj coefficients are found from (6.14), that is, 


b n 


^ | f(t)sinntdt = ^ jj" Asinntdt + J (-A)sinntdt J= (-cosnt|" + cosnt| 2,t ) 
A A 

— (- cosnn + 1 + cos2nn - cosnrc) = — (l-2cosn7i + cos2n7i) 
nn v n7l 


(6.26) 


For n = even, (6.26) yields 
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as expected, since the square waveform has half-wave symmetry. 
For n = odd, (6.21) reduces to 


b n = —(1+2 + 1) 

n nt 


4A 


and thus 



n 




and so on. 

Therefore, the trigonometric Fourier series for the square waveform with odd symmetry is 



(6.27) 


It was stated above that, if the given waveform has half-wave symmetry, and it is also an odd or 
an even function, we can integrate from 0 to n/2 , and multiply the integral by 4. We will apply 
this property to the following example. 


Example 6.2 

Compute the trigonometric Fourier series of the square waveform of Example 1 by integrating 
from 0 to n/2 , and multiplying the result by 4. 

Solution: 

Since the waveform is an odd function and has half-wave symmetry, we are only concerned with 
the odd b n coefficients. Then, 


, . 1 r" /2 , /t , . + 4A. ti /2 . 4A( 

b„ = 4- f(t)sinntdt - —(-cosntL ) = — - 
n 7tJ 0 mi 10 mi v 


- cosn^ +1 


(6.28) 


For n = odd, (6.28) becomes 
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as before, and thus the series is the same as in Example 1. 


(6.29) 


Example 6.3 

Compute the trigonometric Fourier series of the square waveform of Figure 6.15. 

Solution: 

This is the same waveform as in Example 6.1, except that the ordinate has been shifted to the 
right by n/2 radians, and has become an even function. However, it still has half-wave symme¬ 
try. Therefore, the trigonometric Fourier series will consist of odd cosine terms only. 



Since the waveform has half-wave symmetry and is an even function, it will suffice to integrate 
from 0 to n/2, and multiply the integral by 4. The a n coefficients are found from 

a n = 4 ~J f(t)cosntdt = “ |^J Acosntdt J = ^(sinnt|g /2 ) = ~ ( sinn ^) (6.30) 

We observe that for n = even, all a n coefficients are zero, and thus all even harmonics are zero 
as expected. Also, by inspection, the average (DC) value is zero. 

For n = odd, we observe from (6.30) that siting , will alternate between +1 and -1 depending 
on the odd integer assigned to n. Thus, 


a n 


(6.31) 


For n = 1, 5, 9, 13, and so on, (6.30) becomes 
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and for n = 3, 7, 11, 15, and so on, it becomes 


Then, the trigonometric Fourier series for the square waveform with even symmetry is 


4Af 1 1 

f(t) = — coscot—cos3cot + Tcos5cot - .. 
' n v 3 5 


(n-l) 

4A v 2 1 

= — V (- 1 ) -cosncot 

n = odd 


(6.32) 


Alternate Solution: 

Since the waveform of Example 6.3 is the same as of Example 6.1, but shifted to the right by n/2 
radians, we can use the result of Example 6.1, i.e., 

f(t) - — fsincot+^sin3cot +psin5cot+...1 (6.33) 

n v 3 5 j 

and substitute cot with cot + rt/2 , that is, we let cot = cot + 7t/2 . With this substitution, relation 

(6.33) becomes 

f(x) = ^|^sin(wT + ^) + |sin3^cox + ^) +|sin5^cox + ^ + ...J 

(6.34) 

4Ar . f ri] 1 . (- 3txT 1 • 5ii\ 1 

= — I sin^cox + -J + -sm^3cox + —J + -sm^5cox + —J + ... I 

and using the identities sin(x + 7t/2) = cosx, sin(x + 37t/2) = -cosx, and so on, we rewrite 

(6.34) as 


4Ar li i 

f(x) = —I coscox--cos3cox +-cos5cox-... I (6.35) 

and this is the same as (6.27). 

Therefore, if we compute the trigonometric Fourier series with reference to one ordinate, and 
afterwards we want to recompute the series with reference to a different ordinate, we can use the 
above procedure to save time. 
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Example 6.4 

Compute the trigonometric Fourier series of the sawtooth waveform of Figure 6.16. 



Figure 6.16. Sawtooth waveform 


Solution: 

This waveform is an odd function but has no half-wave symmetry; therefore, it contains sine 
terms only with both odd and even harmonics. Accordingly, we only need to evaluate the b n 
coefficients. By inspection, the DC component is zero. As before, we will assume that to = 1. 

If we choose the limits of integration from 0 to 2n we will need to perform two integrations since 


f(t) = 



0 <t<7t 
n<t<2n 


However, we can choose the limits from -n to +n , and thus we will only need one integration 
since 

f(t) = —t —71 < t < 7t 

n 

Better yet, since the waveform is an odd function, we can integrate from 0 to n, and multiply the 
integral by 2 ; this is what we will do. 

From tables of integrals, 

f lx 

xsinaxdx = —sinax—cosax (6.36) 

J a 2 a 

Then, 
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2 r 71 A 2Ar % 2AM t \ I 

b n - - —tsinntdt = — tsinntdt = —- — sinnt--cosnt 

71J 0 n n2J o 7t 2 vn 2 n / 

2A n 2A 

= ^^(sinnt-ntcosnt) Q = ^^(sinn7t - n7tcosn7t) 

We observe that: 

l.If n = even, sinn7t = 0 and cosn7t = 1. Then, (6.37) reduces to 

, 2A . . 2A 

b = -r-^(-nTt) =- 

n 2 7t 2 n7t 

that is, the even harmonics have negative coefficients. 

2. If n = odd, sinn7t - 0, cosn7t = -1 . Then, 

, 2A . . 2A 

b n = T-jCmr) = — 
n 2 7t 2 n7l 

that is, the odd harmonics have positive coefficients. 

Thus, the trigonometric Fourier series for the sawtooth waveform with odd symmetry is 


f(t) = —fsincot-^sin2cot+^sin3cot-7sin4cot+...^1 - —Vf-l) 11 1 -sinncot 
w 7 iV 2 3 4 ) n ’ rr 


(6.37) 


(6.38) 


Example 6.5 

Find the trigonometric Fourier series of the triangular waveform of Figure 6.17. Assume to = 1. 


A A- 

-2ti/ \ 

T ' ' 



o 

a, 

< 


Figure 6.1 7. Triangular waveform for Example 6.5 


Solution: 

This waveform is an odd function and has half-wave symmetry; then, the trigonometric Fourier 
series will contain sine terms only with odd harmonics. Accordingly, we only need to evaluate the 
b n coefficients. We will choose the limits of integration from 0 to 7t/2 , and will multiply the 
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integral by 4. 

By inspection, the DC component is zero. From tables of integrals, 


fxsinaxdx = --rsinax-- cosax 
J a 2 a 


(6.39) 


, 4 r %/1 2A . _ 8A r 71/2 . 8A(1 . + t \1 

b = - —tsmntdt = — tsinntdt = — — sinnt --cosnt 

n J o 71 n J o n m n ' | 

8A . . A ^m /2 8A f . n n n\ 

= — ^(smnt-ntcosnt) Q = ——- I smn- - n-cosn- I 
n 2 7 t n 2 7 t“ V 2 2 2 / 

We are only interested in the odd integers of n, and we observe that: 


(6.40) 


For odd integers of n, the sine term yields 

1 for n = 1,5,9,... then, b n 


-1 for n = 3, 7, 11, ... then, b n = — 


n n 
8A 


Thus, the trigonometric Fourier series for the triangular waveform with odd symmetry is 



(n-l) 

f(t) = ^sincot-^sin3cot +j^sin5cot-^sin7cot+... 

) = X 2 "l sinncot 

^ n = odd n 


Example 6.6 

A half-wave rectification waveform is defined as 


f(t) = 


J sincot 

1 o 


0 < cot < 7T 
u < cot < 2u 


Express f(t) as a trigonometric Fourier series. Assume to = 1. 

Solution: 

The waveform for this example is shown in Figure 6.18. 


(6.42) 
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-271 -n 6 n 2n 

Figure 6.18. f (t ) for Example 6.6 

By inspection, the average is a non-zero value, and the waveform has neither odd nor even sym¬ 
metry. Therefore, we expect all terms to be present. The a n coefficients are found from 


1 r 2n 

a = - f(t)cosntdt 
n J n 


For this example, 


A f A f 

a„ = — sintcosntdt + — Ocosntdt 
n n J 0 n J n 

and from tables of integrals 

f, • w ,, cos(m-n)x cos(m + n)x , 2 _ 2 . 

J(sinmx)(cosnx)dx = - (m *„ ) 


Then, 


[ 1 r cos(1 - n 

)t cos(l +n)tin 

{ 2L l-n 

> + " It 


_ A_ I r cos(71 — n7l) cos(7l + n7t) l _ [“ 1 1 

2711 L 1 - n 1+n J Ll-n n+1. 


Using the trigonometric identities 

cos(x-y) = cosxcosy + sinxsiny 

and 

cos(x + y) = cosxcosy - sinxsiny 
cos(7t-n7t) = cos7tcosn7t + sin7tsinn7t = -cosn7t 
cos(7t + n7t) = cos7tcosn7l - sin7tsinn7t = -cosn7t 
Then, by substitution into (6.43), 


we obtain 
and 


.Al 

f-cosn7l -cosn7ll 2 \ 

a{ 

r cosnTt cosnTtl 2 [ 

271 [ 

L“ivir + "mrJ“77^j 

271 [ 

LlV7 + TTfJ + rvJ 


A ( cosn7l + ncosn7l + cosn7l - ncosn7t 

: 2tA , _ 2 


2 

1 - n 


A f cosn7l + 1 A 


(l-n 2 ) 


(6.43) 


(6.44) 


6-20 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 















Waveforms in Trigonometric Form of Fourier Series 

Next, we can evaluate all the a n coefficients, except a,, from (6.44). 

First, we will evaluate a 0 to obtain the DC value. By substitution of n = 0, we get a 0 = 2 A/ji 
T herefore, the DC value is 

1 A 


(6.45) 


We cannot use (6.44) to obtain the value of a,; therefore, we will evaluate the integral 

A f 


From tables of integrals, 


and thus, 


A. r 

a, = — sintcostdt 

n J 0 

J(sinax)(cosax)dx = ^-(sinax) 2 


From (6.44) with r 


= 2, 3, 4, 5, ..., we get 

_ A/ cos 27t + 1 ) 
&2 ” ^ ( 1 - 2 2 ) ' 


_2A 

371 


a 3 = A ( cos37t + 1 ) = o 
7t(l-3 2 ) 

We see that for odd integers of n, a n = 0. However, for n = even, we get 


7t(l-4 2 ) 

1571 

A(cos67t + 1) 

2A 

71(1 -6 2 ) 

3571 

A( cos 87t + 1) 

2A 

7t(l-8 2 ) 

6371 


and so on. 

Now, we need to evaluate the b n coefficients. For this example, 


1 r 2n a r* a r 2 " 

b„ - A- f(t)sinntdt - — sintsinntdt + — Osinntdt 
71 J n Tl Jr. 71 


(6.46) 

(6.47) 

(6.48) 

(6.49) 

(6.50) 

(6.51) 
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and from tables of integrals, 


f, • w . NJ sinfm - n)x sin(m + n)x , 2 , 2 S 
J (smmx)(smnx)dx = ^- ^ (m * n ) 


2(m - n) 2(m + n) 


, _ A l[[~ sin(l-n)t sin( 1 + n)t ~[I 1 

n n 2[L 1-n 1+n J| J 


= Ar s in(l-n)7t_sin(l + n)7t_ 1 

27tL 1-n 1+n J v ' 


that is, all the b n coefficients, except b,, are zero. 

We will find b! by direct substitution into (6.14) for n = 1. Thus, 


(6 - 52) 

u lo 

Combining (6.45) and (6.47) through (6.52), we find that the trigonometric Fourier series for the 
half-wave rectification waveform with no symmetry is 


- A | A ^ A|~ cos2t | cos4t | cos6t | cos8t | 

“ n 2 SU1 n L 3 15 35 63 


(6.53) 


Example 6.7 

A full-wave rectification waveform is defined as 

f(t) = |Asincot| (6.54) 

Express f(t) as a trigonometric Fourier series. Assume to = 1. 

Solution: 

The waveform is shown in Figure 6.19 where the ordinate was arbitrarily chosen as shown. 



-2n -n 0 n 2n 

Figure 6.19. Full—wave rectified waveform with even symmetry 
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By inspection, the average is a non-zero value. We choose the period of the input sinusoid so that 
the output will be expressed in term s of the fundamental frequency. We also choose the limits of 
integration as -n and +n , we observe that the waveform has even symmetry. 

Therefore, we expect only cosine terms to be present. The a n coefficients are found from 
1 r 2n 

a n = - f(t)cosntdt 
n J 0 

where for this example, 

a„ = - f Asintcosntdt = — f sintcosntdt 
7lJ -n 71 “ o 

and from tables of integrals, 

r, ■ , , cos(m-n)x cos(m + n)x ,1.2. 

j(sinmx)(cosnx)dx = (m *„ ) 

cos(x-y) = cos(y-x) = cosxcosy + sinxsiny 


Since 

we express (6.55) as 


2A 1 T cos(n-l)t cos(n+l)t ~|| 
n ' 2\l n-1 n+1 J 


(6.55) 


(6.56) 


_ A J r cos(n- 1)71 _ cos(n+ 1 )7t ~| _ f _1_ 1 1 

" n\ L n-1 n+1 J Ln-1 n+lJ 

A n - cos(n7t + 7t) | cos(n7t -n) - 1 1 

7T L n+1 n-1 J 

To simplify the last expression in (6.56), we make use of the trigonometric identities 
cos(n7i + 7i) = cosmicos7t - sinn7isin7t = -cosrni 

and 

cos(n7l-7t) = cosn7tcos7t + sinn7isin7i = -cosnrc 
Then, (6.56) simplifies to 

a _ Af l + cosn7l 1 + cosn7t l _ Af -2 + (n- 1 )cosn7i - (n + l)cosn7i ~| 

a ” _ 7t L n+1 n-1 J 7T L n 2 _i J 

-2A(cosn7t + 1) , , 

= -^- L n ^ 1 

7t(n -1) 

Now, we can evaluate all the a n coefficients, except a!, from (6.57). First, we will evaluate a 0 to 


(6.57) 
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obtain the DC value. By substitution of n = 0, we get 
„ _ 4A 


Therefore, the DC value i: 


k> = - 

2 n 


From (6.57) we observe that for all n = odd, other than n = 1, a n = 0. 
To obtain the value of a l , we must evaluate the integral 


From tables of integrals, 
and thus, 


a, = -f sintcostdt 
7l J o 

J(sinax)(cosax)dx = j-(sinax) 2 


For n = even, from (6.57) we get 


-2A(cos27i + 1) _ 

4A 

n(2 2 -l) 

371 

-2A(cos47i + 1) _ 

4A 

7t(4 2 - 1) 

1571 

-2A(cos67i + 1) _ 

4A 

7t(6 2 - 1) 

3571 

-2A(cos87i + 1) _ 

4A 

7t(8 2 — 1) 

6371 


(6.58) 


and so on. Then, combining the terms of (6.58) and (6.60) through (6.63) we get 

fft) - — - — J cos 2cot + cos4(ot + cos6cot + cos8cot + 1 
U " n n \ 3 15 35 63 ’ J 


(6.59) 

(6.60) 
(6.61) 
(6.62) 

(6.63) 

(6.64) 


Therefore, the trigonometric form of the Fourier series for the full-wave rectification waveform with 
even symmetry is 
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f(t) = — 
n 


2A 4A 



— - -cosncot 


(6.65) 


n 


This series of (6.65) shows that there is no component of the fundamental frequency. This is 
because we chose the period to be from -n and +n . Generally, the period is defined as the short¬ 
est period of repetition. In any waveform where the period is chosen appropriately, it is very 
unlikely that a Fourier series will consist of even harmonic terms only. 


6.5 Alternate Forms of the Trigonometric Fourier Series 

We recall that the trigonometric Fourier series is expressed as 


f(t) = -a 0 + ajcoscot + a 2 cos2cot + a 3 cos3cot + a 4 cos4cot + ... 
+ tq sin cot + b 2 sin2cot + b 3 sin3cot + b 4 sin4cot + ... 


( 6 . 66 ) 


If a given waveform does not have any kind of symmetry, it may be advantageous of using the 
alternate form of the trigonometric Fourier series where the cosine and sine terms of the same fre¬ 
quency are grouped together, and the sum is combined to a single term, either cosine or sine. 
However, we still need to compute the a n and b n coefficients separately. 

We use the triangle shown in Figure 6.20 for the derivation of the alternate forms. 



b n 
atan — 


c . 


a 


'n 


sin0 


n 



b 


b 


cos0 = sinrn 0 = atan— cp = atan— 

n n a n b n 

Figure 6.20. Derivation of the alternate form of the trigonometric Fourier series 


atan— 
b 


We assume to = 1, and for n = 1, 2, 3, ..., we rewrite (6.66) as 
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f(t) = ia 0 + c x (— cost + — sint) + c 2 (— cos2t+ — sin2t] + .. 

2* ^Ci Ci 2 VC 2 C 2 2 


t- c —cosnt + — sinnt 


1 , cos0!COSt+ sinBjsint 

= -a 0 + c, f '--- 

2 V cos(t-0j) 

. cos0 n cosnt+ sin0 n sinnt 

+ c n f '---') 

V cos(nt-0 n ) ) 

and, in general, for 00 ± 1, we get 


, cos0 2 cos2t+ sin0 2 sin2t. 

. cos(2t-0 2 ) J 


f(t) = |a 0 + y c n cos(ncot-0 n ) = |a 0 + y c n cos()ncot- atari —)) 


Similarly, 


sin(p 1 cost+ cos (p! sint 
sin(t + cp x ) 
sin(p 2 cos2t+ cos(p 2 sin2t. 


c 2 

v sin(2t + (p 2 ) 

and, in general, where to ± 1, we get 


^ sin(p n cosnt + cos(p n sinnt 
v sin(nt + (p n ) J 


f(t) = |a 0 + y c n sin(ncot +(p n ) = |a 0 + y c n sin(ncot + atanj^j 


(6.67) 


( 6 . 68 ) 


The series of (6.67) and (6.68) can be expressed as phasors. Since it is customary to use the cosine 
function in the time domain to phasor transformation, we choose to use the transformation of 
(6.63) below. 


- y c n cos(ncot- atan—<=> |a 0 + y c n Z-at 


(6.69) 


Example 6.8 

Find the first 5 terms of the alternate form of the trigonometric Fourier series for the waveform of 
Figure 6.21. 
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Solution: 

The given waveform has no symmetry; thus, we expect both cosine and sine functions with odd 
and even terms present. Also, by inspection the DC value is not zero. 

We will compute the a n and b n coefficients, the DC value, and we will combine them to get an 
expression in the form of (6.63). Then, 


1 71/2 i 2 n 3 \ n/2 1 \ 2n 

a„ = - 1 (3)cosntdt + - f (l)cosntdt = —sinnt +—sinnt 

71 J 0 ” J n/2 ™ l 0 nJl U 

3.71 1 . . 1 . n 2.71 

= —sinn- h -sinn27t-—smn- = —smn- 

n7t 2 nil nn 2 nn 2 


(6.70) 


We observe that for n = even, a n = 0. 
For n = odd, 


and 


The DC value is 



1 

2 a ° 


1 .7t/2 i.27t i ™ - 

rJ 0 <3)d,+ sL (1)d, -s (3, i« + 0 

Uf +2 ”-f) = rn^ +2 ” ) = l 


The b n coefficients are 


(6.71) 

(6.72) 


(6.73) 
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1 r 71/2 lr 271 -3 1 71/2 -l r 

b„ = - (3)sinntdt+- (l)sinntdt = —cosnt +—cosnt 
nJ n mi L mi 


Ml 2 nn mi 


Then, 


From (6.69), 


b, = 2 /ti 
b 2 = 1/71 
b 3 = 2/371 
b 4 = 1/271 


|a 0 + c n cos^ncot- atan—j <=> |a 0 + ^ c n Z-atan— 


(6.74) 

(6.75) 

(6.76) 

(6.77) 

(6.78) 


c n Z- atari— = + b^Z-atan— = Ja^ + b^Z-0 n = a n -jb n 


(6.79) 


Thus, for n = 1,2, 3, and 4, we get: 


Similarly, 




= /Z.Z-45 0 = ^Z-45°«^cos(cot-45°) 

'2 71 71 


a,-jb 2 = 0-j- = -Z-90°«-cos(2cot-90°) 

7i n n 

-s-4 - if z - 135 °~if cos(3o)t - 135 °> 


(6.80) 


(6.81) 

(6.82) 


(6.83) 

Combining the terms of (6.73) and (6.80) through (6.83), we find that the alternate form of the 
trigonometric Fourier series representing the waveform of this example is 
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f(t) = 1 + - r2V2cos(cot-45°) + cos(2cot-90°) 

2 n 

+ ^pcos(3cot- 135°) + |cos(4cot- 90°) -+ 


(6.84) 


6.6 The Exponential Form of the Fourier Series 

The Fourier series are often expressed in exponential form. The advantage of the exponential 
form is that we only need to perform one integration rather than two, one for the a n , and 
another for the b n coefficients in the trigonometric form of the series. Moreover, in most cases 
the integration is simpler. 

The exponential form is derived from the trigonometric form by substitution of 


jmt -jcot 

coscot = ^-—— 

2 

and 

icot -jcot 

sin cot = ---- 

j2 

into f(t). Thus, 


, fe JC0t -e- ja) S , 

-• +bl l j2 J +bl 

and grouping terms with same exponents, we get 


f(t) = ...+ 


2 j2 ) 






h 2 ] J2cot 


(6.85) 

( 6 . 86 ) 


(6.87) 


( 6 . 88 ) 


The terms of (6.88) in parentheses are usually denoted as 


K a -- b f) = l< a . + j b .) 

(6.89) 

K a - + j) = ! (a ”- jb ” ) 

(6.90) 

To = 2 a o 

(6.91) 
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Then, (6.88) is written as 


f(t) = ...+C_ 2 e“ j2 “ t + C_ 1 e _j “ t + C 0 + C 1 e jlut + C 2 e J 


J2M 


(6.92) 


We must remember that the C ; coefficients, except C 0 , are complex and occur in complex conju¬ 
gate pairs, that is, 

C_ n = C n * (6.93) 

We can derive a general expression for the complex coefficients C n , by multiplying both sides of 
(6.92) by e _jn<ot and integrating over one period, as we did in the derivation of the a n and b n 
coefficients of the trigonometric form. Then, with to = 1, 

2n 2n . 271 

f f(t)e _jnt dt = ••• + [ C_ 2 e -J V" Jnt dt + f C_j e _Jt e _Jnt dt (6.94) 

J o J o J o 

. 271 , 271 

+ C 0 e- Jn ‘dt+ C ie J V jnt dt 

J o J o 

+ I* C 2 e^ 2t e _ ^ nt dt + ... + f C n e'* nt e _jnt dt 

J o J o 

We observe that all the integrals on the right side of (6.97) are zero except the last. Therefore, 
f “"f(t)e -int dt = [ 27t C n e jnt e“ jnt dt = f 2 "c n dt = 2nC n 


and, in general, for to * 1 , 


1 . 271 

C °=2~n\ 0 

1 271 

c n = Yn i 


(6.95) 


C n = | | T f(t)e- jn “‘d(cot) 


(6.96) 


We can derive the trigonometric Fourier series from the exponential series by addition and sub¬ 
traction of the exponential form coefficients C n and C_ n . Thus, from (6.89) and (6.90), 
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or 




a n = C n + C_ n 


(6.97) 

Similarly, 






C n - C_ n = ^(a n -jb n -a n 

-jbj 

(6.98) 

or 







b n = j(C n -C_ n ) 


(6.99) 


Symmetry in Exponential Series 

1. For even functions, all coefficients C { are real 

We recall from (6.89) and (6.90) that 


C_„ = |(a„- j) = |(a„ + jb n ) (6.100) 

and 

c n = i(a n + ^) = ^(a n -jb n ) (6.101) 

Since even functions have no sine terms, the b n coefficients in (6.100) and (6.101) are zero. 
Therefore, both C_ n and C n are real. 

2. For odd functions, all coefficients Cj are imaginary 

Since odd functions have no cosine terms, the a n coefficients in (6.100) and (6.101) are zero. 
Therefore, both C_ n and C n are imaginary. 

3. If there is half-wave symmetry, C n = 0 for n = even 

We recall from the trigonometric Fourier series that if there is half-wave symmetry, all even 
harmonics are zero. Therefore, in (6.100) and (6.101) the coefficients a n and b n are both zero 
for n = even, and thus, both C_ n and C n are also zero for n = even. 

4. If there is no symmetry, f(t) is complex. 

5. C_ n = C n * always 

This can be seen in (6.100) and (6.101) 
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Example 6.9 

Compute the exponential Fourier series for the square waveform of Figure 6.22 below. Assume 
that oj = 1. 



Solution: 

This is the same waveform as in Example 6.1, and as we know, it is an odd function, has half¬ 
wave symmetry, and its DC component is zero. Therefore, the C n coefficients will be imaginary, 
C n = 0 for n = even, and C 0 = 0 . Using (6.95) with to = 1 , we get 


and for n = 0, 

as expected. 
For n * 0, 


C = [ f(t)e jnt dt = -3- j* Ae jn *dt + [ -Ae jnt dt 

n 2 tt J n w 2n J n 271J 


C ° = Ae_ ° dt + J 27 T( - A) e“° d t] = A(tt- 27 t + 7 t) = 0 


C B * i I f ' Ae- Jnt dt + f ‘“-Ae- jnt dt I = f 4AT jnt | + ^e’H 
n 271 LJn K J 271 -jn | 0 -jn 

_ ( l- e -j Mt + e“ JUZ ' l -e“ JU,t ) 


: 1 rA (e -jn-_ 1) + A (e -jn 2 ,_ e - J n, 

271 L-jn jn J 2 j 7 tn 


2 n | -jn | 0 -jn 

-j nJt , -jn2jr jH7T. 


: -A_(l + e - jn2,I -2e- jn7t ) = -A-(e- jn,t -l) 2 

2 j 7 tn ' 2 j 7 tn ' 


For n = even, e JMt = 1; then, 


- -(e J -1)‘ = A-(l-l) = 0 

2 j 7 tn ’ 2 j 7 tn ' 


( 6 . 102 ) 


(6.103) 
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as expected. 


For n = odd, e = -1. Therefore, 



(6.104) 


Using (6.92), that is, 



we obtain the exponential Fourier series for the square waveform with odd symmetry as 



-e- ja,t + e jMt +|e j3cot ' 


2.A * , 1 jncot 
jn n 


(6.105) 


n = odd 


The minus (-) sign of the first two terms within the parentheses results from the fact that 
C_ n = C n *. For instance, since C 3 = 2A/j37i, it follows that C_ 3 = C 3 * = -2A/j37t. We 
observe that f(t) is purely imaginary, as expected, since the waveform is an odd function. 

To prove that (6.105) and (6.22) are the same, we group the two terms inside the parentheses of 
(6.105) for which n = 1 ; this will produce the fundamental frequency sin cot. Then, we group 
the two terms for which n = 3, and this will produce the third harmonic sin 3 cot, and so on. 


6.7 Line Spectra 

When the Fourier series are known, it is useful to plot the amplitudes of the harmonics on a fre¬ 
quency scale that shows the first (fundamental frequency) harmonic, and the higher harmonics 
times the amplitude of the fundamental. Such a plot is known as line spectrum and shows the 
spectral lines that would be displayed by a spectrum analyzer . 


Figure 6.23 shows the line spectrum of the square waveform of Example 6.1. 


Figure 6.23. Line spectrum for square waveform of Example 6.1 


* An instrument that displays the spectral lines of a waveform. 
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Figure 6.24 shows the line spectrum for the half-wave rectification waveform of Example 6.6. 


0 


1 


T 


Figure 6.24. Line spectrum for half-wave rectifier of Example 6.6 
The line spectra of other waveforms can be easily constructed from the Fourier series. 


Example 6.10 

Compute the exponential Fourier series for the waveform of Figure 6.25, and plot its line spectra. 
Assume to = 1. 



Solution: 

This recurrent rectangular pulse is used extensively in digital communications systems. To deter¬ 
mine how faithfully such pulses will be transmitted, it is necessary to know the frequency compo¬ 
nents. 

As shown in Figure 6.25, the pulse duration is T/k. Thus, the recurrence interval (period) T, is 
k times the pulse duration. In other words, k is the ratio of the pulse repetition time to the dura¬ 
tion of each pulse. 

For this example, the components of the exponential Fourier series are found from 

C n s -L f”Ae" jnt dt = A e“ jnt dt (6.106) 

271 j_ n 2n j_ n/k 

The value of the average (DC component) is found by letting n = 0. Then, from (6.106) we get 
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Co = A t r 

0 271 


AY n 
271 v k 


A 

k 


(6.107) 


For the values for n ^ 0 , integration of (6.106) yields 


and thus, 


A -jnti n/k _ A_ _ e jnTl/k - e - jn7l/k 
-jn27t 6 '~ n/k nit j2 

^ sin(n7t/k) _ A sin(n7l/k) 
n7l k n7t/k 


A 

n7l 


*>- if 

sin(n7t/k) 

n7t/k 

n = -o° 



(6.108) 


(6.109) 


The relation of (6.109) has the sinx/x form, and the line spectrum is shown in Figures 6.26 
through 6.28, for k = 2, k = 5 and k = 10 respectively by using the MATLAB scripts below. 


fplotfsin(2,*x) ,/(2.*x)',[-4 4 -0.4 1.2]) 
fplot('sin(5.*x)./(5.*x)',[-4 4 -0.4 1.2]) 
fplot('sin(10.*x)./(10.*x)',[-4 4-0.4 1.2]) 



Figure 6.26. Line spectrum of (6.109) for k = 2 
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Figure 6.27. Line spectrum of (6.109) for k = 5 



Figure 6.28. Line spectrum of (6.112) for k = 10 

The spectral lines are separated by the distance 1/k and thus, as k gets larger, the lines get closer 
together while the lines are further apart as k gets smaller. 


6.8 Numerical Evaluation of Fourier Coefficients 

Quite often, it is necessary to construct the Fourier expansion of a function based on observed 
values instead of an analytic expression. Examples are meteorological or economic quantities 
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whose period may be a day, a week, a month or even a year. In these situations, we need to eval¬ 
uate the integral (s) using numerical integration. 

The procedure presented here, will work for both the waveforms that have an analytical solution 
and those that do not. Even though we may already know the Fourier series from analytical 
methods, we can use this procedure to check our results. 

Consider the waveform of f(x) shown in Figure 6.29, were we have divided it into small pulses of 
width Ax. Obviously, the more pulses we use, the better the approximation. 

If the time axis is in degrees, we can choose Ax to be 2.5° and it is convenient to start at the zero 
point of the waveform. Then, using a spreadsheet, such as Microsoft Excel, we can divide the 
period 0° to 360° in 2.5° intervals, and enter these values in Column A of the spreadsheet. 


f(x) 


x 



Figure 6.29. Waveform whose analytical expression is unknown 

Since the arguments of the sine and the cosine are in radians, we multiply degrees by n 
(3.1459...) and divide by 180 to perform the conversion. We enter these in Column B and we 
denote them as x. In Column C we enter the corresponding values of y = f(x) as measured 
from the waveform. In Columns D and E we enter the values of cosx and the product ycosx 
respectively. Similarly, we enter the values of sinx and ysinx in Columns F and G respectively. 

Next, we form the sums of ycosx and ysinx, we multiply these by Ax, and we divide by n to 
obtain the coefficients a, and b,. To compute the coefficients of the higher order harmonics, we 
form the products ycos2x, ysin2x, ycos3x, ysin3x, and so on, and we enter these in subse¬ 
quent columns of the spreadsheet. 

Figure 6.30 is a partial table showing the computation of the coefficients of the square waveform, 
and Figure 6.31 is a partial table showing the computation of the coefficients of a clipped sine 
waveform. The complete tables extend to the seventh harmonic to the right and to 360° down. 
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ysin3x 1 


0.000 1 

I uei-'o 

0.259 1 

8 

| 009 0 

| 609 0 

0.707 1 


| 998 0 

1 

| 996 0 

1 

1.000 I 

| U66 0 

| 996 0 

1 

| 998 0 

o 

0.707 | 

| 609 0 

| 009 0 

















sin3x 


0.000 

0.131 

0.259 

0.383 

0.500 

0.609 

0.707 

0.793 

0.866 

0.924 

0.966 

0.991 

1.000 

0.991 

0.966 

0.924 

0.866 

0.793 

0.707 

0.609 

0.500 

















ycos3x 1 


0.000 

1 

0.966 

1 

0.866 


0.707 

1 

0.500 

8 

0.259 

o 

0.000 I 

5 

-0.259 | 

8 

9 

-0.500 | 

1 

9 

-0.707 | 

9 

9 



f(t)=4(sinwt/p+sin3wt/3p+sin5wt/5p+ ....) 














cos3x 


1.000 

U660 

0.966 

1 

0.866 


0.707 

1 

0.500 

8 

0.259 


0.000 I 

5 

-0.259 | 

8 

9 

-0.500 | 

1 

9 

-0.707 | 

9 

-0.866 | 







1.273 

0.000 

0.424 

0.000 

0.254 

0.000 

0.180 



ysin2x 


0.000 

0.087 

0.174 

0.259 

0.342 

0.423 

0.500 

0.574 

0.643 

0.707 

0.766 

0.819 

0.866 

0.906 

0.940 

0.966 

0.985 

0.996 

1.000 

0.996 

0.985 







5 

2 

2 

4 

A 

2 

* 



sin2x 


0.000 

0.087 

0.174 

0.259 

0.342 

0.423 

0.500 

0.574 

0.643 

0.707 

0.766 

0.819 

0.866 

0.906 

0.940 

0.966 

0.985 

1 

1.000 

1 

0.985 

Analytical: 



Numerical: 


0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 



ycox2x 


0.000 

0.996 

0.985 

0.966 

0.940 

0.906 

0.866 

0.819 

0.766 

0.707 

0.643 

0.574 

0.500 

0.423 

0.342 

0.259 

0.174 

0.087 

0.000 

-0.087 

-0.174 


Q 

■ 

2 

TO 

l 

A 

TO 




cos2x 


1.000 

9660 

0.985 

9960 

0.940 

9060 

0.866 


0.766 

1 

0.643 

d 

0.500 


0.342 

LO 

0.174 

8 

0.000 

8 

d 

















ysinx 


0.000 

0.044 

0.087 

0.131 

0.174 

0.216 

0.259 

0.301 

0.342 

0.383 

0.423 

39fr0 

0.500 

0.537 

0.574 

0.609 

0.643 

0.676 

0.707 

0.737 

0.766 

B 

0 

d) 

> 







1 


0.000 

0.044 

0.087 

0.131 

0.174 

0.216 

0.259 

0.301 

0.342 

0.383 

0.423 

3917'0 

0.500 

0.537 

0.574 

0.609 

0.643 

0.676 

0.707 

0.737 

0.766 



0 4.0 6.0 




ycosx 


0.000 

1 

0.996 

0.991 

0.985 

0.976 

0.966 

0.954 

0.940 

0.924 

0.906 

0.887 

0.866 

0.843 

0.819 

0.793 

0.766 

0.737 

0.707 

0.676 

0.643 

1 

w 





cosx 


1.000 

6660 

0.996 

0.991 

0.985 

0.976 

0.966 

0.954 

0.940 

0.924 

0.906 

0.887 

0.866 

0.843 

0.819 

0.793 

0.766 

0.737 

0.707 

0.676 

0.643 







1 


0.000 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 

0.044 






f 


0.000 

8 

1.000 

| 

1.000 

8 

1.000 

8 

1.000 

8 

1.000 

8 

1.000| 

8 

1.000| 

| 

1.000| 

8 

1.000| 

8 

1.000| 




§ 




x(rad) 1 


0.000 


0.087 

<2 

0.175 

d 

0.262 

8 

0.349 

8 

0.436 

8 

0.524 1 

8 

0.611 1 

§ 

1 

d 

0.785 1 

§ 

1 

in o in c 


- - ° ° 9 9 V 




1 x(deg) 




S 

2 

1 10.0 

3 

1 15.0 

3 

1 20.0 

3 

1 25.0 

3 

| 30.0 1 

3 

| 35.0 1 

8 

| 40.0 1 

3 

| 45.0 1 

15 

1 



Figure 6.30. Numerical computation of the coefficients of the square waveform (partial listing) 
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Figure 6.31. Numerical computation of the coefficients of a clipped sine waveform (partial listing) 
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6.9 Power Series Expansion of Functions 

A power series has the form 



( 6 . 110 ) 


k = 0 


Some familiar power series expansions for real values of x are 



( 6 . 111 ) 



( 6 . 112 ) 



(6.113) 


The following example illustrates the fact that a power series expansion can lead us to a Fourier 
Series. 


Example 6.11 

If the applied voltage v is small (no greater than 5 volts), the current i in a semiconductor diode 
can be approximated by the relation 


i = a(e kv - 1) 

where a and k are arbitrary constants, and the input voltage is a sinusoid, that is, 


(6.114) 


v = V max coso)t 


(6.115) 


Express the current i in (6.114) as a power series. 

Solution: 

The term e kv inside the parentheses of (6.114) suggests the power series expansion of (6.111). 
Accordingly, we rewrite (6.114) as 



(6.116) 


Substitution of (6.115) into (6.116) yields, 
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i = a kV max coscot + 


(kV coscot) (kV coscot) (kV coscot) 


2! 3! 4! J 

This expression can be simplified with the use of the following trigonometric identities: 


(6.117) 


3 3 1 

cos x = -cosx +-cos3x 
4 4 

cos 4 x - - + ^cos2x + ^cos4x 
8 2 8 


(6.118) 


Then, substitution of (6.118) into (6.117) and after simplification, we obtain a series of the fol¬ 
lowing form: 


i = A 0 + Ajcoscot + A 2 cos2cot + A 3 cos3cot + A 4 cos4cot 4 


(6.119) 


We recall that the series of (6.119) is the trigonometric series form of the Fourier series. We 
observe that it consists of a constant term, a term of the fundamental frequency, and terms of all 
harmonic frequencies, that is, higher frequencies which are multiples of the fundamental fre¬ 
quency. 


6.10 Taylor and Maclaurin Series 

A function f(x) which possesses all derivatives up to order n at a point x = x 0 can be expanded 
in a Taylor series as 


f'(x n ) 2 f n (x 0 ) n 

f(x) = f(x 0 ) + f(x 0 )(x-x 0 ) + -^-(x-x 0 ) + ... + —“ ~(x — x„) 


( 6 . 120 ) 


If x 0 = 0 , (6.120) reduces to 


f(x) = f(0) + f (0)x + —^x 2 


f (n) (0) n 


( 6 . 121 ) 


Relation (6.121) is known as Maclaurin series, and has the form of power series of (6.110) with 
a n = f (n) (0)/n! . 


To appreciate the usefulness and application of the Taylor series, we will consider the plot of Fig¬ 
ure 6.32, where i(v) represents some experimental data for the current-voltage (i-v) characteris¬ 
tics of a semiconductor diode operating at the 0 < v < 5 volts region. 
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Figure 632. Current-voltage (i-v) characteristics for a typical semiconductor diode 
Now, suppose that we want to approximate the function i(v) by a power series, in the neighbor¬ 
hood of some arbitrary point P(v 0 , i 0 ) shown in Figure 6.33. We assume that the first n deriva¬ 
tives of the function i(v) exist at this point. 

We begin by referring to the power series of (6.110), where we observe that the first term on the 
right side is a constant. Therefore, we are seeking a constant that it will be the best approximation 
to the given curve in the vicinity of point P. Obviously, the horizontal line i 0 passes through 
point P, and we denote this first approximation as a 0 shown in Figure 6.34. 
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Figure 6.34■ First approximation of i(v) 

The next term in the power series is the linear term ajX. Thus, we seek a linear term of the form 
a 0 + ajx. But since we want the power series to be a good approximation to the given function for 
some distance on either side of point P, we are interested in the difference v - v 0 . Accordingly, 
we express the desired power series as 

f(v) = a 0 + a 1 (v-v 0 ) + a 2 (v-v 0 ) 2 + a 3 (v-v 0 ) 3 + a 4 (v-v 0 ) 4 +... (6.122) 

Now, we want the linear term a 0 + aj(v - v 0 ) to be the best approximation to the function i(v) 
in the vicinity of point P. This will be accomplished if the linear term has the same slope as the 
given function as shown in Figure 6.35. 



Figure 6.35. Second approximation of i(v) 


It is evident that the slope of i(v) at v 0 is i'(v 0 ) = and therefore, the linear term 
ao + aj(v - v 0 ) can be expressed as i(v 0 ) + i'(v 0 )(v - v 0 ). 
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The third term in (6.122), that is, a 2 (v - v 0 ) is a quadratic and therefore, we choose a 2 such that 
it matches the second derivative of the function i(v) in the vicinity of point P as shown in Figure 
6.36. 



Then, 2a 2 = i"(v 0 ) or a 2 = i"(v 0 )/2. The remaining coefficients a 3 , a 4 , a 5 , and so on of (6.122) 
are found by matching the third, fourth, fifth, and higher order derivatives of the given function 
with these coefficients. When this is done, we obtain the following Taylor series. 

i(v) = i(v 0 ) + i'(v 0 )(v-v 0 ) + 1 -^(v-v 0 ) 2 + 1 -^(v-v 0 ) 3 +... (6.123) 

We can also describe any function that has an analytical expression, by a Taylor series as illus¬ 
trated by the following example. 


Example 6.12 

Compute the first three terms of the Taylor series expansion for the function 

y = f (x) = tanx (6.124) 

at a = n/4. 

Solution: 

The Taylor series expansion about point a is given by 

f n (x) = f(a) + f(a)(x-a) + ^^(x-a) 2 + ^p(x-a) 3 +... (6.125) 

and since we are asked to compute the first three terms, we must find the first and second deriva¬ 
tives of f(x) = tanx. 
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From math tables, —tanx = sec 2 x, so fhx) = sec 2 x. To find f'(x) we need to find the first 
dx 

derivative of sec 2 x, so we let z = sec 2 x. Then, using ^-secx = secx • tanx, we get 



dx dx' 


(6.126) 


Next, using the trigonometric identity 

2 * 2 i 

sec x = tan x + 1 

and by substitution of (6.127) into (6.126), we get, 

— = f'(x) = 2(tan\ + l)tanx 


dx 


(6.127) 


(6.128) 


Now, at point a = n/4 we have: 


f ( a )= f (i) = tan (i) = 1 f(a)= f(^) = 1 + 1 =2 f'(a)= f'(^) =2(1 2 + 1)1 =4 (6.129) 


and by substitution into (6.125), 



(6.130) 


We can also obtain a Taylor series expansion with the MATLAB taylor(f,n,a) function where f 
is a symbolic expression, n produces the first n terms in the series, and a defines the Taylor 
approximation about point a. A detailed description can be displayed with the help taylor com¬ 
mand. For example, the following MATLAB script computes the first 8 terms of the Taylor series 
expansion of y = f(x) = tanx about a = n/4. 

x=sym('x'); y=tan(x); z=taylor(y,8,pi/4); pretty(z) 


2 

1 + 2x - 1/2 pi + 2(x - 1/4 pi) 


3 

+ 8/3(x - 1/4 pi) + 10/3(x - 1/4 pi) 


4 


64 


5 244 


6 2176 


7 


(x - 1/4 pi) + 


(x - 1/4 pi) + 


(x - 1/4 pi) 


15 


45 


315 
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Example 6.13 
Express the function 

y = f(t) = e l (6.131) 

in a Maclaurin’s series. 

Solution: 

A Maclaurin’s series has the form of (6.132), that is, 

f(x) = f(0) + f(0)x + ^Px 2 + ... + ^p x n (6.132) 

For this function, we have f(t) = e l and thus f(0) = 1. Since all derivatives are e l , then, 
f(0) = f'(0) = f"(0) = ... = 1 and therefore, 

f n (t) = l+t + ^ + ^ + ... (6.133) 

MATLAB displays the same result. 

t=sym('t'); fn=taylor(exp(t)); pretty(fn) 

2 3 4 5 

1 + t + 1/2 t + 1/6 t + 1/24 t + 1/120 t 


Example 6.14 

In a semiconductor diode D, the instantaneous current i D and voltage v D are related as 

v n /nV T 

i D (v D ) = I D e (6.134) 

where I D is the DC (average) component of the current, the constant n has a value between 1 
and 2 depending on the material and physical structure of the diode, and V T is the thermal volt¬ 
age which depends on the temperature, and its value at room temperature is approximately 
25 mV. 

Expand this relation into a power series that can be used to compute the current when the volt¬ 
age is small and varies about v D = 0. 

Solution: 

Since the voltage is small and varies about v D = 0, we can use the following Maclaurin’s series. 
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. , v . /n . I'dW 2 3 ,r ,,n 

i d ( v d) = 1 d(°) + 1 d(°) v d + -^— v d + ^— v d+--- (6.135) 

The first term i D (0) on the right side of (6.135) is found by letting v D = 0 in (6.134). Then, 

1d(0) = (6.136) 

To compute the second and third terms of (6.135), we must find the first and second derivatives 
of (6.134). These are: 

’'d( v d) = dv^ D = nV^ IdC an ^ ^d! 0 ) = ' Id (6.137) 

I "d( v d) = — 2 Id = ~ 2 ’ Io e an d I"d(®) = ~ 2 ' Id (6.138) 

d v D n V T n V T 

Then, by substitution of (6.136), (6.137), and (6.138) into (6.135) we get 

Id( v d) = Id ^1 + “Jt v d + jl^ v D + -j (6.139) 
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6.11 Summary 

• Any periodic waveform f(t) can be expressed as 


f(t) = -a 0 + y (a n cosncot + b n sinn(ot) 


where the first term a 0 /2 is a constant, and represents the DC (average) component of f(t). 
The terms with the coefficients a! and b, together, represent the fundamental frequency com¬ 
ponent to. Likewise, the terms with the coefficients a 2 and b 2 together, represent the second 
harmonic component 2 to, and so on. The coefficients a 0 , a n , and b n are found from the fol¬ 
lowing relations: 



1 r 2n 

a„ = - f(t)cosntdt 
7lJ 0 


0 


1 r 271 

b n = - f(t)sinntdt 
7tJ n 


• If a waveform has odd symmetry, that is, if it is an odd function, the series will consist of sine 
terms only. Odd functions are those for which —f(—t) = f(t). 

• If a waveform has even symmetry, that is, if it is an even function, the series will consist of 
cosine terms only, and a 0 may or may not be zero. Even functions are those for which 
f(~t) = f(t) 

• A periodic waveform with period T, has half-wave symmetry if 


-f (t + T/2) = f(t) 


that is, the shape of the negative half-cycle of the waveform is the same as that of the positive 
half-cycle, but inverted. If a waveform has half-wave symmetry only odd (odd cosine and odd 
sine) harmonics will be present. In other words, all even (even cosine and even sine) harmon¬ 
ics will be zero. 

• The trigonometric Fourier series for the square waveform with odd symmetry is 
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The trigonometric Fourier series for the square waveform with even symmetry is 

(n - 1) 

4A f 1 1 \ 4A — 7 —1 

f(t) = — coscot—-cos3cot +-cos5cot-... = — V (-1) -cosncot 

7t V 3 5 ) n sL, K ' n 

n = odd 

The trigonometric Fourier series for the sawtooth waveform with odd symmetry is 

f(t) = —fsincot-^sin2cot +^sin3cot-7sin4cot+ ...1 = — V(-l) n_ 1 -sinncot 
W 7 lV 2 3 4 i 71 Z/ ' n 

The trigonometric Fourier series for the triangular waveform with odd symmetry is 

f(t) = ^ fsincot--sin3cot+^-sin5cot--T-sin7cot+...1 = V (-1) 2 -^sinncot 
7t 2 ^ 9 25 49 j n 2 

n = odd 

The trigonometric Fourier series for the half-wave rectification waveform with no symmetry is 

f(t') = A | A|~ cos2t | cos4t | cos6t | cos8t | 1 

U " n 2 71L 3 15 35 63 "J 

The trigonometric Fourier series for the full-wave rectification waveform with even symmetry 


f(t) = — - ~~ f A— c 

n n fn-n 


-n = 2,4.6,...( n ‘-1) 

The Fourier series are often expressed in exponential form as 

f(t) = ...+C_ 2 e“ j2 “ t + C_ 1 e" jo)t + C 0 + C 1 e j “ t + C 2 e j2 “ t +... 
where the C ; coefficients are related to the trigonometric form coefficients as 

c -» = K a --j) = 

c ” = K a » + y) = l (a »" jb » ) 

_ 1 


The C; coefficients, except C 0 , are complex, and appear as complex conjugate pairs, that is, 
C_„ = C * 
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In general, for co * 1, 


C n = ^ J T f(t)e- jnw *d(cot) = -L J 2 “f(t)e- jam ( 


■ . ^ d(cot) 

T J o 2n J o 

We can derive the trigonometric Fourier series from the exponential series from the relations 

a n = C n + C_ n 

b n = j(C n -C_ n ) 


and 


• For even functions, all coefficients Cj are real 

• For odd functions, all coefficients C ; are imaginary 

• If there is half-wave symmetry, C n = 0 for n = even 


• C_ n = C n * always 

• A line spectrum is a plot that shows the amplitudes of the harmonics on a frequency scale. 

• The frequency components of a recurrent rectangular pulse follow a sinx/x form. 

• We can evaluate the Fourier coefficients of a function based on observed values instead of an 
analytic expression using numerical evaluations with the aid of a spreadsheet. 

• A power series has the form 

^—y k 2 

> a k x = a 0 + a 1 x + a 2 x + ... 


• A function f(x) that possesses all derivatives up to order n at a point x = x 0 can be expanded 
in a Taylor series as 


f(x) = f(x 0 ) + f(x 0 )(x-x 0 ) + ^-j^(x-x 0 ) 2 + ... 


f W (x 0 ) 


(x-x 0 ) 


If x 0 = 0, the series above reduces to 

f(x) = f(0) + f(0)x + ^p x 2 


f (n) (0) n 
n! X 


and this relation is known as Maclaurin series 

• We can also obtain a Taylor series expansion with the MATLAB taylor(f,n,a) function where 
f is a symbolic expression, n produces the first n terms in the series, and a defines the Taylor 
approximation about point a. 
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6.12 Exercises 

1. Compute the first 5 components of the trigonometric Fourier series for the waveform below. 
Assume to = 1. 



2. Compute the first 5 components of the trigonometric Fourier series for the waveform below. 
Assume to = 1. 



+ 




cot 


3. Compute the first 5 components of the exponential Fourier series for the waveform below. 
Assume to = 1. 




A 

f(t) 









0 


4. Compute the first 5 components of the exponential Fourier series for the waveform below. 
Assume to = 1. 



A/2 



0 


f(t) 
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5. Compute the first 5 components of the exponential Fourier series for the waveform below. 
Assume to = 1. 


f(t) 





A 




0 


6. Compute the first 5 components of the exponential Fourier series for the waveform below. 
Assume co = 1. 



7. Compute the first 4 terms of the Maclaurin series for each of the following functions. 

a. f (x) - e -x b. f (x) = sinx c. f (x) = sinhx 
Confirm your answers with MATLAB. 

8. Compute the first 4 terms of the Taylor series for each of the following functions. 

1 71 

a. f(x) = - about a = -1 b. f(x) = sinx about a = -- 

Confirm your answers with MATLAB. 

9. In a non-linear device, the voltage and current are related as 


where k is a constant and V is the DC component of the instantaneous voltage v. Expand 
this function into a power series that can be used to compute the current i, when the voltage 
v is small, and varies about v = 0. 
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6.13 Solutions to End-of-Chapter Exercises 
1. 



This is an even function; therefore, the series consists of cosine terms only. There is no half¬ 
wave symmetry and the average (DC component) is not zero. We will integrate from 0 to n 
and multiply by 2. Then, 


a n = -f — tcosntdt = tcosntdt (1) 

rc J n n n 2] o 


From tables of integrals, 


fxcosaxdx = -4 cos ax + -sin ax 

J a 2 a 


and thus (1) becomes 

2 TU. 

n n 


x + t . Af 2A( 1 t . + 1 A 

a = — —cosnt + -sinnt = — — cosn7t +-sinntn-0 

n 7 L 7t 2V n 2 n n 2 ' 


and since sinntn = 0 for all integer n, 

2A( 1 n 2A , n\ 

a n = — ^ — cosnrc —-J = ——^(cosnrc-1) (2) 

n n n an 


We cannot evaluate the average (l/2)/a 0 from (2); we must use (1). Then, for n = 0 , 


■ Af - 

27t 2J 0 


r 2 2 


A rt_ 
w 2 ' 2 


(1/2)/a 0 = A/2 

We observe from (2) that for n = even, a n = even = 0. Then, 

for n = 1, a, = for n = 3, a 3 = —for n = 5, a 5 = - 
n 3 2 n 

and so on. 


-4 A 

&3 = ^T 2 

7 n 
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Therefore, 


-v.v 1 4A( 1 . 1 .. ,1 ^ A 4A ” 1 

t(t) = -a 0 - — cost +-cos3t + —cos5t + —cos7t + ... -— > —cosnt 

2 a v 9 25 49 s 2 71 ^ n 2 

n = odd 

2 . 




H- 


0 n/2 n 3n/2 n 

This is an even function; therefore, the series consists of cosine terms only. There is no half¬ 
wave symmetry and the average (DC component) is not zero. 

, = 1 Area = 2 x [(A/2) • (7t/2)J + An = 3A- (n/2) = 3A 
2n 2 n 4 


and with 


(1) simplifies to 


2r n/2 2A 2r n 

a = - —tcosntdt + - Acosntdt (1) 

7tJ 0 n nJ n/2 

fxcosaxdx = cos ax +-sin ax = -^(cosax + axsinax) 

J a 2 a a 2 

4Ar 1 ll n/>2 2 A n 

a n = — [-(cosnt+ ntsinnt)J + 


n7t , Ml . mi 


and since sinntn = 0 for all integer n, 

4A mt 2A . mt 4A 2A . njt 4A f mt A 

a_ = -rcos—+—sin—---— sin— = -- cos— -1 

n 2 2 2 MI 2 2 2 nn 2 2 A 2 ) 

n n n n n n 

e i 4A , A i \ 4A ^ A 4A , . .. 2A 

for n = 1, a { = —(0 - 1) = —for n = 2, a 2 = —-(- 1 - 1) = —- 

71 Jl 471 71 

4 A 4 A -4A 

forn = 3, a 3 = —-^(0- 1) = ~—z, for n = 4, a 4 = -^(l-l) = 0 
971 971' 7 2 7l 

We observe that the fourth harmonic and all its multiples are zero. Therefore, 
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f(t) = — - ^fcost + ^cos2t + ^cos3t + . 
4 - 2 V 2 9 




A 

f(t) 









0 1 

2n 


This is neither an even nor an odd function and has no half-wave symmetry; therefore, the 
series consists of both cosine and sine terms. The average (DC component) is not zero. Then, 


and with to = 1 


c n = ^ J o 2 *f(t)e- jncot d(cot) 

C - - h J>^[ J o 'Ae-'d t+ j“oe-'d,] = A 


The DC value is 


For n ^ 0 


Recalling that 




e dt = Alt = - 


c = A r V jnt dt= -A-e-jntf = -^(1 -e- jn7t ) 

271 J 0 -j2n7t | Q j2n7l v 


for n = even, e jn5T = 1 and for n = odd, e Jn7t = -1. Then, 


and 


j2n7t 


( 1 - 1 ) = 0 


-U-(-l)] = A 

jn7l 


-n = odd - j2n7lL 

By substitution into the expression 

f(t) = ...+C_ 2 e _j2 “ t + C_ 1 e" jo,t + C 0 + C 1 e j “ t + C 2 e j2 “ t +. 

we find that 
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A A f 1 -j3oot -jo)t jcot 1 j3cot 

f(t) = — + -e -e +e +-e J - 

2 J7iv 3 


3 


The minus (-) sign of the first two terms within the parentheses results from the fact that 
C_ n = C n *. For instance, since C x = 2A/jn, it follows that C_, = Cj* = -2A/jjr. We 
observe that f(t) is complex, as expected, since there is no symmetry. 


f(t) 


This is the same waveform as in Exercise 3 where the DC component has been removed. 
Then, 


f(t) = ; 


1 -j3o)t 

• 3 6 


; -j® t + e J“ t + l e j30n 4 


It is also the same waveform as in Example 6.9, Page 6-32, except that the amplitude is halved. 
This waveform is an odd function and thus the expression for f(t) is imaginary. 


f(t) 





A 




-71 

0 


n 


1 -71/2 

71/2 ' 


This is the same waveform as in Exercise 3 where the vertical axis has been shifted to make the 
waveform an even function. Therefore, for this waveform C n is real. Then, 


c ^rjy^-rJ’y 


The DC value is 


For n * 0 


A I 

c « ■ s* 


A_f7t + 7t3 
' 27tV2 22 
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A f -jnt , A —jnt I A , 

„ = — e dt = ——e - ——(i 

271 J -i2n7l -i2n7l 


a - jnn/2 ^jnji/2^ 


A_ (e i n . /2 _e-i». /2 ) = A/e Jnn/2 -e~ Jnn/2 A _ A sta mt 
tt y ' nTr v io J nn 2 


) = £ ! 


j2n7l 

and we observe that for n = even, C n = 0 

For n = odd, C n alternates in plus (+) and minus (-) signs, that is, 


Thus, 


C n = — if n = 1,5,9, ... 


C n = if n = 3,7, 11, 


f(t) = V (±-e JI 
2 ^ v mi 


where the plus (+) sign is used with n = 1, 5, 9, ... and the minus (-) sign is used with 
n = 3, 7, 11,....We can express f(t) in a more compact form as 


6 . 



We will find the exponential form coefficients C n from 


From tables of integrals 

Then, 


c - = h 

jxe ax dx = ^y(ax-l) 
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Integrating and rearranging terms we get 

1 r 4A 4 A f e jn7t -e _Jn7C e jn7t + e“ jn7t ^ 2 A e jn7t -e“ jm 

- 

■M- 1 


ft 2 

, mt . \ 

- 1 + n7t sinmt + cos mi - — smn7i 


2nn 

and since sin mi = 0 for all integer n, 


For n - even, C n = 0 and for n = odd, cosmi = -1, and C n = - 
Also, by inspection, the DC component C 0 = 0. Then, 


f(t) = -T 


1 —j3<ot —j cot i cot 1 j3cot 

t -e + e + e + -e -+ 


The coefficients of the terms e j3 “ t and e jwt are positive because all coefficients of C n are 
real. This is to be expected since f(t) is an even function. It also has half-wave symmetry and 
thus C„ = 0 for n = even as we’ve found. 


f'fOf 2 f (0) n 
f(x) = f(0) + f(0)x + 2 ! x 2 + ••• + —^r~ x 

a. f(x) = e _x , f (0) = 1, f(x) = -e" x , f(0) = -1, f'(x) = e“ x , f'(0) = 1, f"(x) = -e _s 
f"(0) = -1, and so on. Therefore, 

f n (x) = 1 -x + --^+ ... 

nv , 2! 3! 

MATLAB displays the same result. 

x=sym('x'); fn=taylor(exp(-x)); pretty(fn) 

2 3 4 5 

1 - x + 1/2 x - 1/6 x + 1/24 x - 1/120 x 
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b. 


f (x) = sinx, f (0) = 0, f(x) = cosx, f(0) = 
f"(x) = -cosx , f"(0) = -1, and so on. Therefore, 

3 5 7 


f„( X ) = X-|y 


5! 7! 


1 , 


f'(x) = -sinx, 


f'(0) = 0, 


MATLAB displays the same result. 
x=sym('x'); fn=taylor(sin(x)); pretty(fn) 

3 5 


x - 1/6 x + 1/120 x 

c. f (x) = sinhx, f (0) = 0, f(x) = coshx , f(0) = 1 , 

f "(x) = coshx, f "(0) = 1, and so on. Therefore, 



f'(x) = sinhx, f'(0) = 0, 


MATLAB displays the same result. 

x=sym('x'); fn=taylor(sinh(x)); pretty(fn) 

3 5 

x + 1/6 x + 1/120 x 


4( x ) = f(a) + f(a)(x-a) + ^^(x-a) 2 + ^^(x-a) 3 +... 

a. f(x) = 1/x, f(a) = f(—1) = -1, f(x) = —1/x 2 , f(a) = f(-1) = -1, f'(x) = 2/x 3 , 
f'(a) = f'(-l) = -2, f"(x) = -6/x 4 , f"(a) = f"(-l) = -6, and so on. Therefore, 

f n (x) = -l-(x+ l)-(x+ l) 2 -(x+ 1) 3 + ... 
or 

f n (x) = -2-x- (x+ l) 2 -(x+ 1) 3 + ... 

MATLAB displays the same result. 

x=sym('x'); y=1/x; z=taylor(y,4,-1); pretty(z) 

2 3 

-2 - x - (x + 1) - (x + 1) 

b. f(x) = sinx, f(a) = f(-7t/4) = -72/2, f(x) = cosx, f(a) = f(-7t/4) = 72/2, 
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f'(x) = -sinx 


f'(a) = f'(-jr/4) = J2/2 , 


f"(x) = -cosx 


f "(a) = f "(-tt/ 4) = -72/2 , and so on. Therefore, 

f n (x) = - 72/2 + ( j2/2)(x + 71/4) + (V2/4)(x + n/4) 2 - (J2/I2)(x + n/4) 3 + ... 
MATLAB displays the same result. 
x=sym('x'); y=sin(x); z=taylor(y,4,-pi/4); pretty(z) 

1/2 1/2 1/2 

- 1/2 2 + 1/2 2 (x + 1/4 pi) + 1/4 2 (x + 1/4 pi) 

1/2 3 

- 1/12 2 (x + 1/4 pi) 


9. 



The Taylor series for this relation is 



Since the voltage v is small, and varies about v = 0, we expand this relation about v = 0 and 
the series reduces to the Maclaurin series below. 


i(v) = i(0) + i'(0)v + 1 -^v 2 + ... (1) 


By substitution of v = 0 into the given relation we get 


i(0) = k 

The first and second derivatives of i are 




and by substitution into (1) 
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MATLAB displays the same result. 

x=sym('x'); i=sym(‘i’); v=sym(‘v’); k=sym(‘k’); V=sym(‘V’);... 
i=k*(1+v/V) A 1.5; z=taylor(i,4,0); pretty(z) 


2 3 

k v k v k v 

k + 3/2 --- + 3/8 - - 1/16 - 

V 2 3 

V V 
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Chapter 1 


Finite Differences and Interpolation 


T his chapter begins with finite differences and interpolation which is one of its most impor¬ 
tant applications. Finite Differences form the basis of numerical analysis as applied to other 
numerical methods such as curve fitting, data smoothing, numerical differentiation, and 
numerical integration. These applications are discussed in this and the next three chapters. 


7.1 Divided Differences 

Consider the continuous function y = f(x) and let x 0 , x,, x 2 , ..., x n | , x n be some values of 
x in the interval x 0 < x < x n . It is customary to show the independent variable x, and its corre¬ 
sponding values of y = f(x) in tabular form as in Table 7.1. 


TABLE 7. 1 The variable x and y = f (x) in tabular form 


X 

f(x) 

x 0 

f ( x o) 

X 1 

f( x i) 

X 2 

f(x 2 ) 



X n- 1 

f ( x n- l) 

X n 

f( X n) 


Let x ; and Xj be any two, not necessarily consecutive values of x, within this interval. Then, the 
first divided difference is defined as: 


„ , f(Xi)-f(x) 

f( Xi ,x,) = —1- L 

J X- - X- 


Likewise, the second divided difference is defined as: 


(7.1) 


f( x i, Xj , x k ) 


_ f(Xj, x j )-f(x i ,x k ) 


(7.2) 
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The third, fourth, and so on divided differences, are defined similarly. 

The divided differences are indicated in a difference table where each difference is placed 
between the values of the column immediately to the left of it as shown in Table 7.2. 


TABLE 7.2 Conventional presentation of divided differences 



Example 7.1 

Form a difference table showing the values of x given as 0, 1, 2, 3, 4, 7, and 9, the values of 
f (x) corresponding to y = f (x) = x 3 , and the first through the fourth divided differences. 

Solution: 


We construct Table 7.3 with six columns. The first column contains the given values of x, the 
second the values of f(x), and the third through the sixth contain the values of the first through 
the fourth divided differences. These differences are computed from (7.1), (7.2), and other rela¬ 
tions for higher order divided differences. For instance, the second value on the first divided dif¬ 
ference is found from (7.1) as 


and third value on the second divided difference is found from (7.2) as 


-93 

-7 


Likewise, for the third divided difference we have 
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TABLE 7.3 Divided differences for Example 7.1 


Function 

Divided Differences 

X 

f(x) = x 3 

First 

Second 

Third 

Fourth 

0 

l 

0 

1 

1 

13 

4 

1 


3 

27 

37 

8 

1 

0 

4 

64 

93 

14 

1 

0 

7 

343 

193 

20 



9 

729 






and for the fourth 


We observe that, if the values of the nth divided difference are the same, as in the fifth column 
(third divided differences for this example), all subsequent differences will be equal to zero. 


In most cases, the values of x in a table are equally spaced. In this case, the differences are sets of 
consecutive values. Moreover, the denominators are all the same; therefore, they can be omitted. 
These values are referred to as just the differences of the function. 

If the constant difference between successive values of x is h, the typical value of x k is 

x k = x 0 + kh for k = ...,- 2 ,- 1 , 0, 1 , 2 , ... (7.3) 

We can now express the first differences in terms of the difference operator A as 

A 4 = 4 + 1-4 (7.4) 

Likewise, the second differences are 

A 2 f k = A(Af k ) = Af k+1 -Af k (7.5) 
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Chapter 7 Finite Differences and Interpolation 


and, in general, for positive integer values of n 

A n f k = A(A n_I f k ) = A n_1 f k+1 -A n_1 f k (7.6) 

The difference operator A obeys the law of exponents, that is, 

A m (A n f k ) = A m + n f k (7.7) 

We construct the difference table in terms of the difference operator A as shown in Table 7.4. 
TABLE 7.4 Divided differences table in terms of the difference operator A 


First Second Third Fourth 


a 2 *2 


A f 0 

A 3 f 0 

A 2 fi A 4 f 0 

A 3 fj 

A 2 f, 


Example 7.2 

Construct a difference table showing the values of x given as 1,2, 3, 4, 5, 6, 7 and 8 , the values of 
f(x) corresponding to y = f(x) = x 3 , and the first through the fourth differences. 
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Divided Differences 


Solution: 

Following the same procedure as in the previous example, we construct Table 7.5. 


TABLE 7.5 Difference table for Example 7.2 



Function 




Differences 

k 

x k 

4 

A4 

a 2 4 

a 3 4 A 4 f k 

1 

1 

l 

7 



2 

2 

8 


12 





19 


6 

3 

3 

27 


18 

0 




37 


6 

4 

4 

64 


24 

0 




61 


6 

5 

5 

125 


30 

0 




91 


6 

6 

6 

216 


36 

0 




127 


6 

7 

7 

343 


42 





169 



8 

8 

512 





We observe that the fourth differences A f k are zero, as expected. 


Using the binomial expansion 


r»u-£L_ 

V j! (n — j; 


we can show that 

A ° f k = f k+„- nf k+„-i +s ^r^ f k + „-2 + -- + (- 1 ) n_ 

For k = 0, n = 1, 2, 3 and 4, relation (7.9) reduces to 


H + i + H)\ 


Af 0 = f 2 -fj 
A 2 f 0 = f 2 - 2f, + f 0 
A 3 f 0 = f 3 -3f 2 + 3f 1 -f 0 
A 4 f 0 = f 4 - 4f 3 + 6f 2 -4fj + f 0 


(7.8) 

(7.9) 


(7.10) 
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Chapter 7 Finite Differences and Interpolation 


It is interesting to observe that the first difference in (7.10), is the difference quotient whose limit 
defines the derivative of a continuous function that is defined as 

lim lim (7.1!) 

Ax —> o Ax Ax— >0 Ax 

As with derivatives, the nth differences of a polynomial of degree n are constant. 


7.2 Factorial Polynomials 

The factorial polynomials are defined as 


and 


(x)^ = x(x-l)(x-2)...(x-n+1) 

(7.12) 

(x)- (n) = 1 

(x- l)(x —2)...(x + n) 

(7.13) 


These expressions resemble the power functions x n and x n in elementary algebra. 
Using the difference operator A with (7.12) and (7.13) we obtain 


and 


(7.14) 

(7.15) 


We observe that (7.14) and (7.15) are very similar to differentiation of x 11 and x n . 

Occasionally, it is desirable to express a polynomial p n (x) as a factorial polynomial. Then, in anal¬ 
ogy with Maclaurin power series, we can express that polynomial as 

p n (x) = a 0 + aj(x) (1) + a 2 (x) (2) + ... + a n (x/ n ) (7.16) 

and now our task is to compute the coefficients a k . 

For x = 0, relation (7.16) reduces to 

a 0 = P„(0) (7.17) 

To compute the coefficient a,, we take the first difference of p n (x)in (7.16). Using (7.14) we 
obtain 

Ap n (x) = lx°a[ + 2a 2 (x)^ + 3a 3 (x/ 2 ' ) + ... + na n (x/ n ~ ^ (7.18) 

and letting x = 0, we find that 
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Factorial Polynomials 


a! = Ap n (0) 

(7.19) 

Differencing again we obtain 


A 2 p n ( x ) = 2 • la 2 + 3 • 2a 3 (x)^ + ... + n(n- l)a n (x/ n ^ 

(7.20) 

and for x = 0, 


A 2 p n (0) A 2 p n (0) 

a 9 — - — - 

2 2-1 2! 

(7.21) 

In general, 


aV(0) 


a: = , for j = 0, 1,2, ...,n 

(7.22) 


Factorial polynomials provide an easier method of constructing a difference table. With this 

method we perform the following steps: 

1. We divide p n (x) in (7.16) by x to obtain a quotient q 0 (x) and a remainder r 0 which turns out 
to be the constant term a 0 . Then, we express (7.16) as 

P n ( x ) = r o + x qo( x ) (7.23) 

2. We divide q 0 (x) in (7.23) by (x-1) to obtain a quotient q,(x) and a remainder r, which 
turns out to be the constant term a { . Then, 

q 0 ( x ) r j + ( x - l)qj(x) (7.24) 

By substitution of (7.24) into (7.23), and using the form of relation (7.16), we obtain 

p n ( x ) = r o + x l r i + ( x - !)qi( x )l = r 0 + r i( x ) (1) + x ( x - 1 )qi( x ) (7.25) 

3. We divide qj(x) in (7.25) by (x-2) to obtain a quotient q 2 (x)and a remainder r 2 which 
turns out to be the constant term a 2 , and thus 

qd x ) = r 2 + ( x - 2 )q 2 ( x ) (7.26) 

By substitution of (7.26) into (7.25), we obtain 

P n ( x ) = r 0 + r 1 (x) (1) + x(x-l)[r 2 + (x-2)q 2 (x)] 

= r o + r 1 (x) (1) + r 2 (x) (2) + x(x- l)(x-2)q 2 (x) 
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Continuing with the above procedure, we obtain a new quotient whose degree is one less than 
preceding quotient and therefore, the process of finding new quotients and remainders terminates 
after (n + 1) steps. 

The general form of a factorial polynomial is 

P n ( x ) = r 0 + r l( x ) (1) + r 2( x ) (2)+ ••• + r n-l( x ) (n_1) + r n( x ) (n) (7.28) 


and from (7.16) and (7.22), 


or 


A J p n (0) 
A j Pn (0) = j! rj 


(7.29) 

(7.30) 


Example 7.3 

Express the algebraic polynomial 

p(x) = x 4 -5x 3 + 3x + 4 (7.31) 

as a factorial polynomial. Then, construct the difference table with h = 1. 

Solution: 


Since the highest power of the given polynomial p(x) is 4, we must evaluate the remainders 
r 0 , r 1; r 2 , r 3 and r 4 ; then, we will use (7.28) to determine p n (x). We can compute the remainders 
by long division, but for convenience, we will use the MATLAB deconv(p,q) function which 
divides the polynomial p by q. 


The MATLAB script is as follows: 


px=[1 -5 0 3 4]; 
d0=[1 0]; 

[q0,r0]=deconv(px,d0) 
d1=[1 -1]; 

[q1,r1]=deconv(q0,d1) 
d2=[1 -2]; 

[q2,r2]=deconv(q1 ,d2) 
d3=[1 -3]; 

[q3,r3]=deconv(q2,d3) 
d4=[1 -4]; 

[q4,r4]=deconv(q3,d4) 


% Coefficients of given polynomial 
% Coefficients of first divisor, i.e, x 
% Computation of first quotient and remainder 
% Coefficients of second divisor, i.e, x-1 
% Computation of second quotient and remainder 
% Coefficients of third divisor, i.e, x-2 
% Computation of third quotient and remainder 
% Coefficients of fourth divisor, i.e, x-3 
% Computation of fourth quotient and remainder 
% Coefficients of fifth (last) divisor, i.e, x-4 
% Computation of fifth (last) quotient and remainder 


q0 = 
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1-503 

rO = 

0 0 0 0 4 

qi = 

1 -4 -4 

rl = 

0 0 0 -1 

q2 = 

1 -2 

r2 = 

0 0-8 

q3 = 

1 

r3 = 

0 1 

q4 = 

0 

r4 = 

1 

Therefore, with reference to (7.28), the factorial polynomial is 

p n (x) = 4 - (x) (1) - 8(x) (2) + (x) (3) + (x) (4) (7.32) 

We can verify that (7.32) is the same polynomial as (7.31), by expansion of the factorials using 
(7.12). This can be easily done with the MATLAB collect(‘s_expr’) function, where ‘s_expr’ is 
a symbolic expression. For this example, the MATLAB script is 

syms x; px=collect((x*(x-1 )*(x-2)*(x-3))+(x*(x-1 )*(x-2))-(8*x*(x-1))—x+4) 
px = 

x A 4-5*x"''3 + 3*x+4 

We observe that this is the same algebraic polynomial as in (7.31). 

We will now compute the leading entries for the difference table using (7.30) and (7.32). Then, 
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A°p(0) = 

0! 

4 = 

4 

A 1 

P(0) = 

1! 

(-1) 

= -1 

A : 

P(0) = 

2! 

(-8) 

= -16 

A ; 

P(0) = 

3! 

1 = 

6 

a" 

p(0) = 

4! 

1 = 

24 

A f 

P(0) = 

5! 

0 = 

0 


(7.33) 


1. We enter the values of (7.33) in the appropriate spaces as shown in Table 7.6. 

2. We obtain the next set of values by crisscross addition as shown in Table 7.7. 

3. The second crisscross addition extends the difference table as shown in Table 7.£ 


TABLE 7.6 Leading entries of (7.33) in table form 


P(x) 






TABLE 7.7 Crisscross addition to find second set of values 


X 

p(x) 

A 

A 2 

A 3 

A 4 

A 5 


4 








-1 






3 


-16 






-17 


6 






-10 


24 






30 


0 






24 
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Factorial Polynomials 


TABLE 7.8 Second crisscross addition to find third set of values 

x p(x) 

4 


^ /gv 






4. Continuation of this procedure produces the complete difference table. This is shown in Table 
7.9. 

TABLE 7.9 Complete difference table for Example 7.3 


X 

p(x) 

A 

A 2 

A 3 

A 4 

A 5 


4 








-1 






3 


-16 






-17 


6 




-14 


-10 


24 




-27 


30 


0 


-41 


20 


24 




-7 


54 




-48 


74 






67 






19 
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Chapter 7 Finite Differences and Interpolation 


7.3 Antidifferences 

We recall from elementary calculus that when we know the first derivative of a function, we can 
integrate or antidifferentiate to find the function. By a similar method, we can find the antidifference 
of a factorial polynomial. We denote the antidifference as A _1 p n (x). It is computed from 


A (xp ' = 


,(n) _ (xT 


(n+1) 


(7.34) 


Example 7.4 

Compute the antidifference of the algebraic polynomial 

p(x) = x 4 -5x 3 + 3x + 4 (7.35) 

Solution: 

This is the same algebraic polynomial as that of the previous example, where we found that the 
corresponding factorial polynomial is 

p n (x) = 4 - (x) (1) - 8(x) (2) + (x) (3) + (x) (4) (7.36) 


Then, by (7.34), its antidifference is 


A P n (x) 


- 


4 


c (at 


(aT 

2 


i" 4(xp 


(7.37) 


where C is an arbitrary constant. 


Antidifferences are very useful in finding sums of series. Before we present an example, we need 
to review the definite sum and the fundamental theorem of sum calculus. These are discussed 
below. 

In analogy with definite integrals for continuous functions, in finite differences we have the defi¬ 
nite sum of p n (x) which for the interval a < x < a + (n - l)h is denoted as 

a + (n — 1 )h 

^ p n (x) = p n (a) + p n (a + h) + p n (a + 2h) + ... + p n [a + (n - 1 )h] (7.38) 

Also, in analogy with the fundamental theorem of integral calculus which states that 
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Antidifferences 


,b 

j f(x)dx = f(b) - f(a) 


(7.39) 


we have the fundamental theorem of sum calculus which states that 



(7.40) 


Example 7.5 

Derive a simple expression, in closed form, that computes the sum of the cubes of the first n odd 
integers. 


Solution: 

An odd number can be expressed as 2m- 1, and thus its cube is (2m- l) 3 . To use (7.40), we 
must express this term as a factorial polynomial. Recalling from (7.12) that 


(X) (n) = x(x- l)(x~2)...(x-n+ 1) 


(7.41) 


and using the MATLAB expand(f) function where f is a symbolic expression, we execute 
syms m; f = (2*m-1) A 3; expand(f) 

and we obtain 
ans = 

8 *m /s 3 -12 *nD 2 + 6 *m-1 
Thus 


p(m)= (2m- l) 3 = 8m 3 - 12m 2 + 6m - 1 


(7.42) 


Following the procedure of Example 7.3, we find p n (m) with MATLAB as 

pm=[8 -12 6 -1]; 
d0=[1 0]; 

[qO,rO]=deconv(pm,dO) 
d1=[1 -1]; 

[q1,r1]=deconv(q0,d1) 
d2=[1 -2]; 

[q2,r2]=deconv(q1 ,d2) 
d3=[1 -3]; 

[q3,r3]=deconv(q2,d3) 

q0 = 

8 -12 6 
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Chapter 7 Finite Differences and Interpolation 


rO = 
ql = 


0 


rl = 
q2 = 


0 


0 

-4 

0 


0 -1 


2 


r2 = 

0 12 

q3 = 

0 

r3 = 

8 

Therefore, 

p n (m) = 8(m) (3) + 12(m) (2) + 2(m) (1) - 1 
Taking the antidifference of (7.43) we obtain 

A -i , , 8(m) (4) 12(m) (3) , 2(m) (2) . ,(i) 

A P n ( m ) = 4 + 3 + - L y-( m ) 

and with (7.40) 

^cubes = 2(m/ 4 ^ + 4(m)^ + (m/ 2 ^ - ( m )^| m _ ^ 

= 2(n+ l)n(n-l)(n-2) + 4(n+l)n(n-l) + (n+ l)n-(n+l) 
-2(1) (4) -4 ( 1) (3) -(1) (2) + ( 1) (1) 

Since 

(1) (4) = 1(1 — 1)(1 — 2)(1 - 3) = 0 
(1) (3) = 1(1 - 1)(1 -2) = 0 
(1) (2) = 1(1-1) = 0 
(1) (1) = 1 

relation (7.45) reduces to 


^cubes = 2(n + l)n(n-l)(n-2) + 4(n + l)n(n-1) + (n + l)n-(n + 1) + 1 


(7.43) 


(7.44) 


(7.45) 


(7.46) 


(7.47) 
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Newton’s Divided Difference Interpolation Method 

and this can be simplified with the MATLAB collect(f) function as follows. 

syms n; sum=collect(2*(n+1 )*n*(n-1 )*(n-2)+4*(n+1 )*n*(n-1 )+(n+1 )*n-(n+1 )+1) 
sum = 

2 *n / ''4-n /s 2 

that is, 

^cubes = 2n 4 -n 2 = n 2 (2n 2 -l) (7.48) 

We can verify that this is the correct expression by considering the first 4 odd integers 
1, 3, 5, and 7. The sum of their cubes is 

1 + 27 + 125 + 343 = 496 

This is verified with (7.48) since 

n 2 (2n 2 -l) = 4 2 (2-4 2 -l) = 16-31 = 496 


One important application of finite differences is interpolation. Newton’s divided-difference inter¬ 
polation method, Lagrange’s interpolation method, Gregory-Newton forward, and Gregory- 
Newton backward interpolation methods are discussed in Sections 7.4 through 7.7 below. We 
will use spreadsheets to facilitate the computations. Interpolation using MATLAB is discussed in 
Section 7.8 below. 

7.4 Newton’s Divided Difference Interpolation Method 

This method, has the advantage that the values x 0 , x v x 2 , ..., x n need not be equally spaced, or 
taken in consecutive order. It uses the formula 

f(x) = f(x 0 ) + (x-x 0 )f(x 0 ,x 1 ) + (x-x 0 )(x-x 1 )f(x 0 ,x 1 ,x 2 ) 

+ (x - x 0 )(x - x^(x - x 2 ) f(x 0 , x l5 x 2 , x 3 ) 

where f(x 0 , x,), f(x 0 , Xj, x 2 ), and f(x 0 , x l5 x 2 , x 3 ) are the first, second, and third divided differ¬ 
ences respectively. 


Example 7.6 

Use Newton’s divided-difference method to compute f(2) from the experimental data shown in 
Table 7.10. 
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TABLE 7 .10 Data for Example 7.6 


X 

-1.0 

0.0 

0.5 

1.0 

2.5 

3.0 

y = f(x) 

3.0 

-2.0 

-0.375 

3.0 

16.125 

19.0 


Solution: 

We must compute the first, second, and third divided differences as required by (7.49). 
The first divided differences are: 


-2,000-3.000 


0-1 

[-1.0) 

-0.375- 

(-2.000) 

0.5- 

0.0 

3.000- 

(-0.375) 

1.0- 

-0.5 

16.125-3.000 

2.5 

-1.0 

19.000 

-16.125 

3.0 

-2.5 


-5.000 


3.250 

6.750 

8.750 

5.750 


The second divided differences are: 


3.250-(-5.000) = 5 50Q 
0.5-(-1.0) 


1 . 0 - 0.0 
8.750-6.750 . 


5.750-8.750 
3.0- 1.0 


-1.500 


and the third divided differences are: 

3.500-5.500 
1 . 0 -(- 1 . 0 ) 
1.000-3.500 
2.5-0.0 
- 1.500- 1.000 
3.0-0.5 


With these values, we construct the difference Table 7.11. 


(7.50) 


(7.51) 


(7.52) 
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Lagrange’s Interpolation Method 


TABLE 7 .11 Difference table for Example 7.6 




1st Divided Difference 

2nd Divided Difference 

3rd Divided Difference 

X 

f(x) 

f( x o> x i) 

f( x 0, x i, x 2 ) 

f (x 0 , Xj, x 2 , x 3 ) 

-1.0 

3.000 

-5.000 



0.0 

-2.000 

3.250 

5.500 

-1.000 

0.5 

-0.375 

6.750 

3.500 

-1.000 

1.0 

3.000 

8.750 

1.000 

-1.000 

2.5 

16.125 

5.750 

-1.500 


3.0 

19.000 





Now, we have all the data that we need to find f(2). We start with x 0 = 0.00, and for x in 
(7.49), we use x = 2 . Then, 

f(2) = - 2.0 + (2 - 0)(3.250) + (2 - 0)(2 - 0.5)(3.500) + (2 - 0)(2 - 0.5)(2 - 1)(-1.000) 

= -2.0 + 6.5 + 10.5-3 
= 12 

This, and other interpolation problems, can also be solved with a spreadsheet. The Excel spread¬ 
sheet for this example is shown in Figure 7.1. 


7.5 Lagrange’s Interpolation Method 

Lagrange’s interpolation method uses the formula 


f(x) 


(x-x 1 )(x-x 2 )...(x-x n ) ^ + (x-x 0 )(x-x 2 )...(x-x n ) 

(x 0 -xi)(xo- x 2 )...(x 0 -x n ) (X ° (x 1 -x 0 )(x 1 -x 2 )...(x 1 -x n ) ^ 

(x-x 0 )(x-x 1 )...(x-x n _ 1 ) 

+ ( X n- X o)( X n- X 2)"-(X n -X n _ 1 ) ^ 


(7.53) 


and, like Newton’s divided difference method, has the advantage that the values x 0 , x u x 2 , ..., x n 
need not be equally spaced or taken in consecutive order. 


* We chose this as our starting value so that f(2) will be between f(l) and f (2.5) 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


7-17 











Chapter 7 Finite Differences and Interpolation 


Interpolation with Newton's Divided Difference Formula 


f(x) =f(x 0 )+(x-x 0 )f(x 0 ,x 1 )+(x-x 0 )(x-x 1 )f(x 0 ,x 1 ,x 2 )+(x-x 0 )(x-x 1 )(x-x 2 )f(x 0 ,x 1 ,x 2> x 3 ) 


In this example, we want to evaluate f(x) at x=]2 





1st divided 

2nd divided 

3rd divided 






difference 

difference 

difference 




X 

f(x) 

f(x„, x,) 

f(x 0 , x v x 2 ) 

f(x 0 ,x 1 ,x 2 ,x 3 ) 




-1.00 

3.000 









-5.000 






0.00 

-2.000 


5.500 







3.250 


-1.000 




0.50 

-0.375 


3.500 







6.750 


-1.000 




1.00 

3.000 


1.000 







8.750 


-1.000 




2.50 

16.125 


-1.500 







5.750 






3.00 

19.000 







We use the above formula w ith starting value > 

0.00 




f(2)=B12+(E3-E18)*C13+(E3-E18)*(E3-A14)*D14+(E3-E18)*(E3-A14)*(E3-A16)*E15 


or f ( 2 )=| 12.00 




The plot below verifies that our answ er is correct 




-1.000 

3.000 






f 


A 




0.000 

-2.000 


X 1U 







0.500 

-0.375 







1.000 

3.000 







2.500 

16.125 







3.000 

19.000 



10 








x 







V _ _ J 





Figure 7. 1 . Spreadsheet for Example 7.6 


Example 7.7 

Repeat Example 7.6 using Lagrange’s interpolation formula. 

Solution: 

All computations appear in the spreadsheet of Figure 7.2 where we have used relation (7.53). 
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Gregory-Newton Forward Interpolation Method 



A | B | C | D 

E 

F 

G 

H 

1 

J 

K 

L 

■1 

Lagrange's Interpolation Method 









2 

1 1 







Numer. 

Denom. 

Division 

b 

Interpol, at x= 

2 






Partial 

Partial 

of Partial 

4 










Prods 

Prods 

Prods 

b 


X 

f(x) 

X-X! 

x-x 2 

x-x 3 

X-X 4 

x-x 5 

f(x») 




D 

Xo 

-1.00 

3.000 

2.000 

1.500 

1.000 

-0.500 

-1.000 

3.000 

4.500 



/ 

Xi 

0.00 

-2.000 

Xo-X, 

x„-x 2 

X0-X3 

x 0 -x 4 

X0-X5 




-0.107 

ti 

X 2 

U.bU 


-1.000 

-l.bOO 

-2.000 

-3.500 

-4.000 



-42.000 


y 

X 3 

1.00 

3.000 

x-x„ 

x-x 2 

x-x 3 

x-x 4 

x-x 5 

f(*i) 




IU 

X 4 

2.50 

16.125 

3.000 

1.500 

1.000 

-0.500 

-1.000 

-2.000 

-4.500 



■i i 

X 5 

3.00 

19.000 

x,-x„ 

x,-x 2 

X1-X3 

Xi-x 4 

X1-X5 




-1.200 

\2 




1.000 

-O.bOO 

-1.000 

-2.500 

-3.000 



3T5f7 


lb 




x-x 0 

X-Xi 

X-X3 

x-x 4 

x-x 5 

f(x 2 ) 




14 




3.000 

2.000 

1.000 

-0.500 

-1.000 

-0.375 

-1.125 



’lb 




x 2 -x„ 

x 2 -x. 

X2-X3 

x 2 -x 4 

X2-X5 




0.600 

lb 




l.bOO 

O.bOO 

-O.bOO 

-2.000 

-2.b00 



-1.87b 


1 ( 




x-x„ 

X-Xi 

x-x 2 

x-x 4 

x-x 5 

f(x 3 ) 




18 




3.000 

2.000 

1.500 

-0.500 

-1.000 

3.000 

13.500 



iy 




x 3 -x 0 

X3-X1 

x 3 -x 2 

x 3 -x 4 

X3-X5 




4.500 

2U 




2.000 

1.000 

O.bOO 

-l.bOO 

-2.000 



3.UUU 


2 1 




x-x 0 

X-Xi 

x-x 2 

x-x 3 

x-x 5 

f(x 4 ) 




22 




3.000 

2.000 

1.500 

1.000 

-1.000 

16.125 

-145.125 



£3 




X4-X0 

x 4 -x. 

x 4 -x 2 

X4-X3 

x 4 -x 5 




11.057 

24 




3.b00 

2.b00 

2.000 

rcotr 

-0.500 



-13.125 


2b 




x-x„ 

X-X! 

x-x 2 

x-x 3 

X-X4 

f(x 5 ) 




2b 




3.000 

2.000 

1.500 

1.000 

-0.500 

19.000 

-85.500 



Zl 




X5-X0 

x 5 -x. 

x 5 -x 2 

X5-X3 

X5-X4 




-2.850 

2ti 




4.000 

3.000 

2-b00 

2.000 

O.bOO 



3U.UUU 


2M 













3U 










f(2)= 

Sum= 

12 


Figure 1.2. Spreadsheet for Example 7.7 


7.6 Gregory-Newton Forward Interpolation Method 

This method uses the formula 


f(x) = f 0 + r Af 0 + ^A 2 f 0 + r ii^fl^)A 3 f 0+ . 


(7.54) 


where f 0 is the first value of the data set, Af 0 , A 2 f 0 , and A 3 f 0 are the first, second, and third for¬ 
ward differences respectively. 


The variable r is the difference between an unknown point x and a known point x x divided by 
the interval h, that is, 


r = (x-xQ 


(7.55) 


* This is an expression to indicate that we use the differences in a forward sequence, that is, the first entries on the columns 
where the differences appear. 
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Chapter 7 Finite Differences and Interpolation 


The formula of (7.54) is valid only when the values x 0 , Xj, x 2 , x n are equally spaced with inter¬ 
val h. It is used to interpolate values near the smaller values of x, that is, the values near the 
beginning of the given data set. The formula that we will study on the next section, is used to 
interpolate values near the larger values of x, that is, the values near the end of the given data 
set. 


Example 7.8 

Use the Gregory-Newton forward interpolation formula to compute f(1.03) from the following 
data. 


TABLE 7.12 Table for Example 7.8 


X 

1.00 

1.05 

1.10 

1.15 

1.20 

1.25 

y = f(x) 

1.000000 

1.257625 

1.531000 

1.820875 

2.128000 

2.453125 


Solution: 


We enter the given x and f(x) values in a difference table; then, we compute the first, second, 
and third differences. These are not divided differences and therefore, we simply subtract the second 
value of f(x) from the first, the third from the second, and so on, as shown in Table 7.13. 

For this example, 

f 0 = f(1.00) = 1.000000 

h = x t - x 0 = 1.05-1.00 = 0.05 (7 56) 

x-x, 1 03 - 1 00 

r = -1 = UE2—Edd = o.60 

h 0.05 


and with the values shown in Table 7.13 and using (7.54), we obtain 

f(1.03) = 1.000000 + (0.60) • (0.257625) + (0 - 60) ' ^- 60 ~ 1} 

+ (0.60) • (0.60- 1)( 0.60-2) . (a000750) = U52727 


(7.57) 


The spreadsheet of Figure 7.3 shows the layout and computations for this example. 
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Gregory-Newton Backward Interpolation Method 


TABLE 7.13 Difference table for Example 7.8 




1st Difference 

2nd Difference 

3rd Difference 

X 

f(x) 

f(*0’ X l) 

f(x 0 , x,,x 2 ) 

f(x 0 , X,,x 2 , x 3 ) 

1.00 

1.000000 

0.257625 



1.05 

1.257625 

0.273375 

0.015750 

0.000750 

1.10 

1.531000 

0.289875 

0.016500 

0.000750 

1.15 

1.820875 

0.307125 

0.017250 

0.000750 

1.20 

2.128000 

0.325125 

0.018000 


1.25 

2.453125 





7.7 Gregory-Newton Backward Interpolation Method 

This method uses the formula 

f (x) = f 0 + rAf_j + r(r + 1 ) A 2 f_ 2 + r (r+lKr + 2) A 3 f ^ + (7.5 8 ) 

where f 0 is the first value of the data set, Af_j, A 2 f_ 2 , and A 3 f_ 3 are the first, second and third 
backward differences, and 

r _ (x-x t ) 
h 

Expression (7.58) is valid only when the values x 0 , x l5 x 2 , x n are equally spaced with interval 
h. It is used to interpolate values near the end of the data set, that is, the larger values of x. 
Backward interpolation is an expression to indicate that we use the differences in a backward 
sequence, that is, the last entries on the columns where the differences appear. 


Example 7.9 

Use the Gregory-Newton backward interpolation formula to compute f( 1.18) from the data set 
of Table 7.14. 
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Gregory-Newton Forward Interpolation Method 




1 1 1 





See expressions (7.54) and (7.55) 





1 1 






Interpolate f(x) at x= 

1.03 













X 

f(x) 

Af 

A2f 

A3f 




1.00 

1.000000 









0.257625 






1.05 

1.257625 


0.015750 







0.273375 


0.000750 




1.10 

1.531000 


0.016500 







0.289875 


0.000750 




1.15 

1.820875 


0.017250 







0.307125 


0.000750 




1.20 

2.128000 


0.018000 







0.325125 






1.25 

2.453125 















h= 

A10-A8= 

0.05 

r= 

(D5-A8)/C20 

0.6 











f (1.12)= 

B8+F20*C9+( F20*( F20-1 )*D10)/FACT(2; 

)+(F20*( F20-1 )*( F20-2' 

)*E11)/FACT(3) 


= 

1.152727 















1.00 

1.000000 


f* 







1.05 

1.257625 


3.00 -i 







1.10 

1.531000 






1.15 

1.820875 




1.20 

2.128000 






1.25 

2.453125 




1.00 














000 











nn i nc -i -in a ar -ion a 











1 1 II" 



Figure 7.3. Spreadsheet for Example 7.8 


TABLE 7.14 Data for Example 7.9 


X 

1.00 

1.05 

1.10 

1.15 

1.20 

1.25 

y = f(x) 

1.000000 

1.257625 

1.531000 

1.820875 

2.128000 

2.453125 


7-22 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 
























































































Solution: 


Gregory-Newton Backward Interpolation Method 


We arbitrarily choose f 0 = 2.128000 as our starting point since f( 1.18) lies between f( 1.15) and 
f( 1.20). Then, 


and 


h = 1.20-1.15 = 0.05 


r = (x- Xl )/h = (1.18 - 1.20)/0.05 = -0.4 

Now, by (7.58) we have: 


f( 1 . 18 ) = 2.128 + (~ 0 . 4 )( 0 . 307125 ) + ( Q ' 4)( 2! °' 4 + 1 \ o. 01725 ) 

+ (-0- 4 )(- 0-4 + 1)(~ 0-4 + 2 ) ( 0 ooo75 )= 2.003032 

The computations were made with the spreadsheet of Figure 7.4. 

If the increments in x values are small, we can use the Excel VLOOKUP function to perform 
interpolation. The syntax of this function is as follows. 

VLOOKUP(lookup_value, table_array, col_index_num, range lookup) 

where: 


lookup_value is the value being searched in the first column of the lookup table 
table_array are the columns forming a rectangular range or array 
col_index_num is the column where the answer will be found 

range lookup is a logical value (TRUE or FALSE) that specifies whether we require VLOOKUP to 
find an exact or an approximate match. If TRUE is omitted, an approximate match is returned. 
In other words, if an exact match is not found, the next largest value that is less than the 
lookupjvalue is returned. If FALSE is specified, VLOOKUP will attempt to find an exact match, 
and if one is not found, the error value #N/A will be returned. 

A sample spreadsheet is shown in Figure 7.5 where the values of x extend from -5 to +5 volts. 
Only a partial table is shown. 
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Figure 7A. Spreadsheet for Example 7.9 


7.8 Interpolation with MATLAB 

MATLAB has several functions that perform interpolation of data. We will study the following: 

1. interp1(x,y,Xi) performs one dimensional interpolation where x and y are related as y = f(x) 
and x t is some value for which we want to find y (x t ) by linear interpolation, i.e., “table lookup”. 
This command will search the x vector to find two consecutive entries between which the 
desired value falls. It then performs linear interpolation to find the corresponding value of y. To 
obtain a correct result, the components of the x vector must be monotonic, that is, either in 
ascending or descending order. 
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Interpolation with MATLAB 


V 

1 


f ' ' 

A 




-2.000 

-0.0330 


020 







-1.975 

-0.0326 


0JB 






-1.950 

-0.0323 


0.05 




-1.925 

-0.0320 


0.00 






-1.900 

-0.0316 


0.05 


3 1 2 3 4 




-1.875 

-0.0313 


V 





-1.850 

-0.0309 


A B 



-1.825 

-0.0306 


8 -1.8500 

-0.0309266 




-1.800 

-0.0302 

9 -1.8250 

-0.0305803 




-1.775 

-0.0299 







-1.750 

-0.0295 


=VLOOKUF(-1.8375,A2:B282,2) = 

-0.030927 


-1.725 

-0.0292 


=VLOOKUP(-1.8375,A2:B282,2,TRUE) = 

-0.030927 


-1.700 

-0.0288 


=VLOOKUP(-1.8375, A2:B282,2, FALSE) = 

#N/A 


-1.675 

-0.0285 






-1.650 

-0.0281 


A B 




-1.625 

-0.0277 


264 4.5500 

265 4.5750 

0.1484323 




-1.600 

-0.0274 

0.1496775 




-1.575 

-0.0270 







-1.550 

-0.0267 


=VLOOKUP(4.5535,A2:B282,2) = X 

0.1484323 


-1.525 

-0.0263 


1 L 




Figure 7.5. Using the Excel VLOOKUP function for interpolation 


2 . interp1(x,y,Xi,’method’) performs the same operation as interp1(x,y,Xj) where the string 
method allows us to specify one of the methods listed below. 

nearest - nearest neighbor interpolation 
linear - linear interpolation; this is the default interpolation 
spline - cubic spline interpolation; this does also extrapolation 
cubic - cubic interpolation; this requires equidistant values of x 

3. interp2(x,y,z,x i ,y i ) is similar to interp1(x,y,Xi) but performs two dimensional interpolation; 

4. interp2(x,y,z,x i ,y i ,’method’) is similar to interp1(x,y,Xj,’method’) but performs two dimen¬ 
sional interpolation. The default is linear. The spline method does not apply to two dimen¬ 
sional interpolation. 

We will illustrate the applications of these functions with the examples below. 
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Chapter 7 Finite Differences and Interpolation 


Example 7.10 

The i - v (current-voltage) relation of a non-linear electrical device is given by 

i(t) = 0.1(e 02v(t) -1) (7.59) 

where v is in volts and i in milliamperes. Compute i for 30 data points of v within the interval 
-(2<v<5), plot i versus v in this range, and using linear interpolation compute i when 
v = 1.265 volts. 

Solution: 

We are required to use 30 data points within the given range; accordingly, we will use the MAT- 

LAB linspace(first_value, last_value, number_of_values) command. The script below pro¬ 
duces 30 values in volts, the corresponding values in milliamperes, and plots the data for this 
range. Then, we use the interp1(x,y,x i ) command to interpolate at the desired value. 

% This script is for Example_7_10.m 

% It computes the values of current (in milliamps) vs. voltage (volts) 

% for a diode whose v-i characteristics are i=0.1(exp(0.2v)-1). 

% We can use the MATLAB function 'interpl 1 to linearly interpolate 
% the value of milliamps for any value of v within the specified interval. 

% 

v=linspace(-2, 5, 30); % Specify 30 intervals in the -2<=v<=5 interval 

a=0.1 .* (exp(0.2 .* v)—1); % We use "a" for current instead of "i" to avoid conflict 

% with imaginary numbers 

v_a=[v;a]'; % Define "v_a" as a two-column matrix to display volts 

% and amperes side-by-side. 

plot(v,a); grid; 

title('volt-ampere characteristics for a junction diode 1 ); 
xlabel('voltage (volts)'); 
ylabelfcurrent (milliamps) 1 ); 

fprintf(' volts milliamps \n'); % Heading of the two-column matrix 
fprintff \n'); 

disp(v_a); % Display values of volts and amps below the heading 

ma=interp1 (v,a,1.265); % Linear (default) interpolation 

fprintf('current (in milliamps) @ v=1.265 is %2.4f \n', ma) 

The data and the value obtained by interpolation are shown below, 
volts milliamps 

- 2.0000 - 0.0330 

- 1.7586 - 0.0297 

- 1.5172 - 0.0262 

- 1.2759 - 0.0225 
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-1.0345 

-0.0187 

-0.7931 

-0.0147 

-0.5517 

-0.0104 

-0.3103 

-0.0060 

-0.0690 

-0.0014 

0.1724 

0.0035 

0.4138 

0.0086 

0.6552 

0.0140 

0.8966 

0.0196 

1.1379 

0.0256 

1.3793 

0.0318 

1.6207 

0.0383 

1.8621 

0.0451 

2.1034 

0.0523 

2.3448 

0.0598 

2.5862 

0.0677 

2.8276 

0.0760 

3.0690 

0.0847 

3.3103 

0.0939 

3.5517 

0.1035 

3.7931 

0.1135 

4.0345 

0.1241 

4.2759 

0.1352 

4.5172 

0.1468 

4.7586 

0.1590 

5.0000 

0.1718 


current (in milliamps) @ v=1.265 is 0.0288 
The plot for this example is shown in Figure 7.6. 
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voltage (volts) 


Figure 7.6. Plot for Example 7.10 


Example 7.11 
Plot the function 

y = f(x) = cos 5 x (7.60) 

in the interval 0<x<2rcwith 120 intermediate values. Then, use the MATLAB 
interp1(x,y,Xi,’method’) function to interpolate at n/8, n/4, 3n/5, and 3n/7. Compare the 
values obtained with the linear, cubic, and spline methods, with the analytical values. 

Solution: 

The script below plots (7.60) and produces the values of analytical values, for comparison with 
the linear, cubic, and spline interpolation methods. 

% This is the script for Example_7_11 

% 

x=linspace(0,2*pi,120); % We need these two 

y=(cos(x)) , A 5; % statements for the plot 

% 

analytic=(cos([pi/8 pi/4 3*pi/5 3*pi/7]'). A 5); 

% 

plot(x,y); grid; title('y=cos A 5(x)'); xlabel('x'); ylabel('y'); 

% 

linear_int=interp1(x,y,[pi/8 pi/4 3*pi/5 3*pi/7]', 'linear'); 

% The label 'linear' on the right side of the above statement 
% could be have been omitted since the default is linear 

% 

cubic_int=interp1(x,y,[pi/8 pi/4 3*pi/5 3*pi/7]', 'cubic'); 
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% 

spline_int=interp1(x,y,[pi/8 pi/4 3*pi/5 3*pi/7]','spline'); 

% 

y=zeros(4,4);% Construct a 4 x 4 matrix of zeros 
y(:,1)=analytic; % 1st column of matrix 

y(:,2)=linear_int; % 2nd column of matrix 

y(:,3)=cubic_int; % 3rd column of matrix 

y(:,4)=spline_int; % 4th column of matrix 

fprintf(' \n'); % Insert line 

fprintf('Analytic \t Linear Int \t Cubic Int \t Spline Int \n') 
fprintff \n'); 

fprintf('%8.5f\t %8.5f\t %8.5f\t %8.5f\n',y') 
fprintf(' \n'); 

% 

% The statements below compute the percent error for the three 
% interpolation methods as compared with the exact (analytic) values 

% 

error1=(linear_int-analytic).*100 ./ analytic; 
error2=(cubic_int-analytic).*100 ./ analytic; 
error3=(spline_int-analytic).*100 ./ analytic; 

% 


z=zeros(4,3); 
z(:,1)=error1; 
z(:,2)=error2; 
z(:,3)=error3; 
% fprintf(' \n'); 


% Construct a 4 x 3 matrix of zeros 
% 1st column of matrix 
% 2nd column of matrix 
% 3rd column of matrix 
% Insert line 


disp('The percent errors for each interpolation method are:') 
fprintf(' \n'); 

fprintf('Linear Int \t Cubic Int \t Spline Int \n') 
fprintf(' \n'); 

fprintf('%8.5f\t %8.5At %8.5f\n',z') 
fprintf(' \n'); 

The plot for the function of this example is shown in Figure 7.7. 
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Figure 7.7. Plot the function of Example 7 .11 


The analytical and interpolated values are shown below for comparison. 


Analytic 

0.67310 

0.17678 

-0.00282 

0.00055 


Linear Int 

0.67274 

0.17718 

-0.00296 

0.00062 


Cubic Int 

0.67311 

0.17678 

-0.00281 

0.00054 


Spline Int 

0.67310 

0.17678 

-0.00282 

0.00055 


The percent errors for each interpolation method are: 


Linear Int 

-0.05211 

0.22707 

5.09681 

13.27678 


Cubic Int 

0.00184 

- 0.00012 

-0.40465 

-0.64706 


Spline Int 

0.00002 

0.00011 

-0.01027 

-0.07445 


Example 7.12 

For the impedance example of Section 1.7 in Chapter 1 whose script and plot are shown below, 
use the spline method of interpolation to find the magnitude of the impedance at to = 792 rad/s. 

Solution: 

% The file is Example_7_12.m 

% It calculates and plots the impedance Z(w) versus radian frequency w. 
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% 

% Use the following five statements to obtain |Z| versus radian frequency w 

w=300:100:3000; 

z=zeros(28,2); 

z(:,1)=w'; 

z(:,2)=(10+(10. A 4-j.*10. A 6./w)./(10+j.*(0.1 ,*w-10 A 5./w)))'; 
fprintf('%2.0f\t %10.3f\n',abs(z)') 

% 

w=[300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500.... 

1600 1700 1800 1900 2000 2100 2200 2300.... 

2400 2500 2600 2700 2800 2900 3000]; 
z=[39.339 52.789 71.104 97.665 140.437 222.182 436.056 1014.938... 
469.830 266.032 187.052 145.751 120.353... 

103.111 90.603 81.088 73.588 67.513 62.481... 

58.240 54.611 51.468 48.717 46.286 44.122... 

42.182 40.432 38.845]; 
semilogx(w,z); grid; 

title('Magnitude of Impedance vs. Radian Frequency 1 ); 
xlabel('w in rads/sec 1 ); ylabel('|Z| in Ohms'); 

% 

zi=interp1 (w,z,792,'spline'); 
fprintf(' \n') 

fprintfj'Magnitude of Z at w=792 rad/s is %6.3f Ohms \n', zi) 
fprintff \n') 

The plot for the function of this example is shown in Figure 7.8. 



Figure 7.8. Plot for the function of Example 7.12 
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Chapter 7 Finite Differences and Interpolation 


MATLAB interpolates the impedance at to = 792 rad/s and displays the following message: 
Magnitude of Z at w=792 rad/s is 217.034 Ohms 


Two-dimensional plots were briefly discussed in Chapter 1. For convenience, we will review the 
following commands which can be used for two-dimensional interpolation. 

1. mesh(Z) - Plots the values in the matrix Z as height values above a rectangular grid, and con¬ 
nects adjacent points to form a mesh surface. 

2. [X,Y]=meshgrid(x,y) - Generates interpolation arrays which contain all combinations of the 
x and y points which we specify. X and Y comprise a pair of matrices representing a rectangular 
grid of points in the x - y plane. Using these points, we can form a function z = f(x, y) where 
z is a matrix. 


Example 7.13 

Generate the plot of the function 

2 _ sinR 


(7.61) 


in three dimensions x, y, and z. This function is the equivalent of the function y = sinx/x in 
two dimensions. Here, R is a matrix that contains the distances from the origin to each point in 
the pair of [X, Y] matrices that form a rectangular grid of points in the x - y plane. 

Solution: 


The matrix R that contains the distances from the origin to each point in the pair of [X, Y] 
matrices, is 

R = Jx 2 + Y 2 (7.62) 


We let the origin be at (x 0 ,y 0 ) = (0,0), and the plot in the intervals -2n<x<2n and 
-2n < y < 2n . Then, we write and execute the following MATLAB script. 


% This is the script for Example_7_13 


x=-2*pi: pi/24: 2*pi; 

y=x; 

[X,Y]=meshgrid(x,y); 

R=sqrt(X. A 2 + Y. A 2); 
Z=sin(R)./ (R+eps); 
mesh(X,Y,Z); 

xlabel('x'); ylabel('y'); zlabel('z'); 


% Define interval in increments of pi/24 
% y must have same number of points as x 
% Create X and Y matrices 
% Compute distances from origin (0,0) to x-y points 
% eps prevents division by zero 
% Generate mesh plot for Z=sin(R)/R 
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title('Plot for the Three-dimensional sin(R) / R Function') 

The plot for the function of this example is shown in Figure 7.9. 



Figure 7.9. Plot for Example 7.13 


Example 7.14 

Generate the plot of the function 

z = x 3 + y 3 - 3xy (7.63) 

in three dimensions x, y, and z. Use the cubic method to interpolate the value of z at x = -1 
and y = 2 . 

Solution: 


We let the origin be at (x 0 , y 0 ) = (0,0), and the plot in the intervals -10<x< 10 and 
-10<y<10 . Then, we write and execute the following script. 


% This is the script for Example_7_14 

x=-10: 0.25: 10; % Define interval in increments of 0.25 

y=x; % y must have same number of points as x 

[X,Y]=meshgrid(x,y); % Create X and Y matrices 

Z=X. A 3+Y. A 3-3.*X.*Y; 

mesh(X,Y,Z); % Generate mesh plot 

xlabel('x'); ylabel('y'); zlabel('z'); 

title('Plot for the Function of Example 7.14'); 

z_int=interp2(X,Y,Z, -1,2,'cubic'); 

fprintff \n') 
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fprintf('lnterpolated Value of z at x = -1 and y = 2 is z = %4.2f \n',z_int) 
fprintff \n') 

The plot for the function of this example is shown in Figure 7.10. 


Figure 7.10. Plot for Example 7.14 

Interpolated Value of z at x = -1 and y = 2 is z - 13.00 



Example 7.15 

A land surveyor measured and recorded the data below for a rectangular undeveloped land which 
lies approximately 500 meters above sea level. 


500.08 

500.15 

500.05 

500.08 

500.14 

500.13 

500.09 

500.15 

500.12 

500.01 

500.11 

500.18 

500.15 

500.12 

500.05 

500.15 

500.13 

500.12 

500.09 

500.11 

500.11 

500.05 

500.15 

500.02 

500.09 

500.17 

500.17 

500.14 

500.16 

500.09 

500.02 

500.11 

500.08 

500.09 

500.13 

500.18 

500.14 

500.14 

500.14 

500.15 

500.15 

500.10 

500.11 

500.11 

500.12 

500.13 

500.14 

500.12 

500.17 

500.12 

500.13 

500.18 

500.13 

500.15 

500.17 

500.11 

500.13 

500.14 

500.13 

500.09 

500.14 

500.16 

500.17 

500.14 

500.15 

500.09 

500.14 

500.18 

500.17 

500.08 

500.13 

500.09 

500.12 

500.15 

500.14 

500.01 

500.16 

500.12 

500.11 

500.10 

500.02 

500.19 

500.01 

500.08 

500.12 

500.02 

500.16 

500.12 

500.19 

500.21 

500.17 

500.03 

500.17 

500.09 

500.14 

500.17 


This rectangular land parcel is 175 meters wide and 275 meters deep. The measurements shown 
above were made at points 25 meters apart. 
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a. Denoting the width as the x - axis, the depth as the y - axis and the height as the z - axis, 
plot the given data to form a rectangular grid. 

b. Interpolate the value of z at x = 108 m, and y = 177 m. 

c. Compute the maximum height and its location on the x - y plane. 

Solution: 

The MATLAB script and plot are shown below and explanations are provided with comment 
statements. 

% This script is for Example_7_15 

% 

x=0: 25:175; % x-axis varies across the rows of z 
y=0: 25: 275; % y-axis varies down the columns of z 
z=[500.08 500.15 500.05 500.08 500.14 500.13 500.09 500.15; 

500.12 500.01 500.11 500.18 500.15 500.12 500.05 500.15; 

500.13 500.12 500.09 500.11 500.11 500.05 500.15 500.02; 

500.09 500.17 500.17 500.14 500.16 500.09 500.02 500.11; 

500.08 500.09 500.13 500.18 500.14 500.14 500.14 500.15; 

500.15 500.10 500.11 500.11 500.12 500.13 500.14 500.12; 

500.17 500.12 500.13 500.18 500.13 500.15 500.17 500.11; 

500.13 500.14 500.13 500.09 500.14 500.16 500.17 500.14; 

500.15 500.09 500.14 500.18 500.17 500.08 500.13 500.09; 

500.12 500.15 500.14 500.01 500.16 500.12 500.11 500.10; 

500.02 500.19 500.01 500.08 500.12 500.02 500.16 500.12; 

500.19 500.21 500.17 500.03 500.17 500.09 500.14 500.17]; 

% 

mesh(x,y,z); axis([0 175 0 275 500 502]); grid off; box off 

xlabel('x-axis, m 1 ); ylabel('y-axis, m 1 ); zlabel('Height, meters above sea level 1 ); title('Parcel 
map 1 ) 

% The pause command below stops execution of the program for 10 seconds 

% so that we can see the mesh plot 

pause(IO); 

z_int=interp2(x,y,z, 108,177,'cubic'); 

disp('lnterpolated z is:'); zjnt 

[xx,yy]=meshgrid(x,y); 

xi=0: 2.5:175; % Make x-axis finer 

% size(xi); % Returns a row vector containing the size of xi where the 

% first element denotes the number of rows and the second is the number 

% of columns. Here, size(xi) = 1 71 

disp('size(xi)'); size(xi) 

yi=0: 2.5: 275; % Make y-axis finer 

disp('size(yi)'); size(yi) 

[xxi,yyi]=meshgrid(xi,yi); % Forms grid of all combinations of xi and yi 
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% size(xxi) = size(yyi) = size(zzi) = 111 71 

disp('size(xxi)'); size(xxi); disp('size(yyi)'); size(yyi); disp('size(zzi)'); size(zzi) 
size(xxi), size(yyi), size(zzi) 

zzi=interp2(x,y,z,xxi,yyi,'cubic'); % Cubic interpolation - interpolates 
% all combinations of xxi and yyi and constructs the matrix zzi 
mesh(xxi,yyi,zzi); % Plot smoothed data 

hold on; 

[xx,yy]=meshgrid(x,y); % Grid with original data 

plot3(xx,yy,z,'*k'); axis([0 175 0 275 500 503]); grid off; box off 
xlabel('x-axis, m'); ylabel('y-axis, m'); zlabel('Height, meters above sea level'); 
title('Map of Rectangular Land Parcel') 
hold off; 

% max(x) returns the largest element of vector x 

% max(A) returns a row vector which contains the maxima of the columns 
% in matrix A. Likewise max(zzi) returns a row vector which contains the 
% maxima of the columns in zzi. Observe that size(max(zzi)) = 1 71 
% and size(max(max(zzi))) = 1 1 

zmax=max(max(zzi)) % Estimates the peak of the terrain 

% The 'find' function returns the subscripts where a relational expression 
% is true. For Example, 

% A=[a11 a12 a13; a21 a22 a23; a31 a32 a33] or 
% A=[-1 0 3; 2 3 -4; -2 5 6]; 

% [i,j]=find(A>2) 

% returns 



% 2 
% 3 

% 1 
% 3 

% 

% 

%j = 

% 

% 2 
% 2 
% 3 

% 3 

% That is, the elements a22=3, a32=5, a13=3 and a33=6 
% satisfy the condition A>2 

% The == operator compares two variables and returns ones when they 
% are equal, and zeros when they are not equal 

% 

[m,n]=find(zmax==zzi) 

% m = 
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% 

% 65 
% 

% n = 

% 

% 36 
% 

% that is, zmax is located at zzi = Z(65)(36) 

% 

% the x-cordinate is found from 
xmax=xi(n) 

% xmax = 

% 

% 1.7500 % Column 36; size(xi) = 1 71 
% and the y-coordinate is found from 
ymax=yi(m) 

% ymax = 

% 

% 3.2000 % Row65; size(yi) = 1 111 

% Remember that i is the row index, j is the column index, and x-axis 
% varies across the rows of z and y-axis varies down the columns of z 

Interpolated z is: 
z_int = 

500.1492 

size(xi) 
ans = 

1 71 

size(yi) 
ans = 

1 111 

size(xxi) 

ans = 

111 71 

size(yyi) 

ans = 

111 71 

zzi=interp2(x,y,z,xxi,yyi,'cubic'); % Cubic interpolation - interpolates 
% all combinations of xxi and yyi and constructs the matrix zzi 
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size(zzi) 

ans = 

111 71 

zmax=max(max(zzi)) % Estimates the peak of the terrain 

zmax = 

500.2108 

m = 

111 

n= 

9 

xmax = 

20 

ymax = 

275 

These values indicate that z max = 500.21 where the x and y coordinates are x = 20 and 
y = 275 . The interpolated value of z at x = 108 m and y = 177 m is z = 500.192. The plot is 
shown in Figure 7.11. 

Map of Rectangular Land Paicel 



Figure 7.11. Plot for Example 7.15 
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7.9 Summary 

• The first divided difference is defined as: 


„ n fCxjJ-fCx,) 

f(Xj, X.) = -J- 

J Xj — Xj 

where x ; and Xj are any two, not necessarily consecutive values of x, within an interval. 

> Likewise, the second divided difference is defined as: 

V f(x ; , Xj)-f(Xj, X k ) 

f(Xi,X.,X k ) = -J- J - 

x i- x k 

and the third, fourth, and so on divided differences are defined similarly. 

' If the values of x are equally spaced and the denominators are all the same, these values are 
referred to as the differences of the function. 

' If the constant difference between successive values of x is h, the typical value of x k is 


x k = x 0 + kh for k = ...,- 2 ,- 1 , 0, 1 , 2 , ... 

• We can now express the first differences are usually expressed in terms of the difference oper¬ 
ator A as 


A 4 = 4 + i-4 


• Likewise, the second differences are expressed as 

A 2 f k = A(Af k ) = Af k+1 -Af k 
and, in general, for positive integer values of n 

A n 4 = A(A n-1 f k ) = A n - l f k+l -A n -\ 

• The difference operator A obeys the law of exponents which states that 

A m (A n f k ) = A m + n f k 

• The nth differences A n f k are found from the relation 

For k = 0, n = 1, 2, 3 and 4, the above relation reduces to 
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Af 0 = f 2 -f 3 
A 2 f 0 = f 2 - 2f| + f 0 
A 3 f 0 = f 3 -3f 2 + 3f 1 -f 0 
A 4 f 0 = f 4 - 4f 3 + 6f 2 -4fj + f 0 

• As with derivatives, the nth differences of a polynomial of degree n are constant. 

• The factorial polynomials are defined as 

(X) (n) = x(x— l)(x —2)...(x —n+ 1) 

and 

(x)- (n) = _I_ 

(x- l)(x-2)...(x + n) 

Using the difference operator A with the above relations we obtain 
A(x) (n) = 

and 

A(x)-< n) = -n(x)- (n -'> 

These are very similar to differentiation of x and x . 

• We can express any algebraic polynomial f n (x) as a factorial polynomial p n (x). Then, in anal¬ 
ogy with Maclaurin power series, we can express that polynomial as 

p n (x) = a 0 + aj(x) (1) + a 2 (x/ 2 ^ + ... + a n (x/ n ^ 

where 

A j p n (0) f , _ 

aj = -7j- tor j = 0, 1, 2, ..., n 

• Factorial polynomials provide an easier method of constructing a difference table. The proce¬ 
dure is as follows: 

1. We divide p n (x) by x to obtain a quotient q 0 (x) and a remainder r 0 which turns out to be 
the constant term a 0 . Then, the factorial polynomial reduces to 

P n ( x ) = r o + X£ lo( x ) 
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2. We divide q 0 (x) by (x - 1), to obtain a quotient q, (x) and a remainder r, which turns out 
to be the constant term a l . Then, 

q 0 (x) = rj + (x- l)qj(x) 

and by substitution we obtain 

P n ( x ) = r 0 + xt r i + (x-i)qi(x)] = r 0 + r 1 (x) (1) + x(x- l)qj(x) 

3. We divide q,(x) by (x - 2), to obtain a quotient q 2 (x) and a remainder r 2 which turns out 
to be the constant term a 2 , and thus 

qi(x) = r 2 + (x - 2)q 2 (x) 

and by substitution we obtain 

P n ( x ) = r 0 + r i( x ) (1) + x ( x - i)[r 2 + ( X - 2)q 2 ( x )] 

= r 0 + r x (x) (1) + r 2 (x) (2) + x(x- l)(x-2)q 2 (x) 

and in general, 

P n ( x ) = r o + r i( x ) (1) + r 2( x ) (2) + ••• +r n-i( x ) (n 1) + r n( x ) (n) 

where 

A j p n (0) 

r i = a i = — 

• The antidifference of a factorial polynomial is analogous to integration in elementary calculus. 
It is denoted as A -1 p n (x), and it is computed from 


A \x) (n) = ^ 


(n+l) 


(n+1) 

1 Antidifferences are very useful in finding sums of series. 

1 The definite sum of p n (x) for the interval a < x < a + (n - 1 )h is 

ct + (n-l)h 

y P n (x) = p n (a)+ p n (a+ h)+ p n (a +2h) + ... + p n [a + (n-l)h] 

1 In analogy with the fundamental theorem of integral calculus which states that 

, b 

J f(x)dx = f(b)-f(a) 
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we have the fundamental theorem of sum calculus which states that 


a + (n - 1)h 

X P n ( x ) = A Pn( x )| a 

• One important application of finite differences is interpolation. 

• Newton’s Divided Difference Interpolation Method uses the formula 

f(x) = f(x 0 ) + (x-x 0 )f(x 0 ,x 1 ) + (x-x 0 )(x-x 1 )f(x 0 , x 1; x 2 ) 
+ ( x - x o)( x - x i)( x - x a) f ( x o> x l» x 2> x 3) 


where f(x 0 , Xj), f(x 0 , x ]5 x 2 ), and f(x 0 , x |; x 2 , x 3 ) are the first, second, and third divided differ¬ 
ences respectively. This method has the advantage that the values x 0 , x 1; x 2 , ..., x n need not 
be equally spaced, or taken in consecutive order. 

• Lagrange’s Interpolation Method uses the formula 

_ ( x x l)( x x 2) • • • ( x — x n ) ( x — x 0 ) ( x — x 2 ) • • • ( x — x n ) 

X "" ( x 0 - x l)( x 0 - x 2)---( x 0 - x n) X ° + ( X 1 - x o)( X l - x 2)---( x l - x n) ^ 
(x-x 0 )(x-x 1 )...(x-x n _ 1 ) 

+ ( x n- x 0)( x n- x 2)”'( x n- x n-l) 

and, like Newton’s divided difference method, has the advantage that the values 
x 0 , x^ x 2 , ..., x n need not be equally spaced or taken in consecutive order. 

• The Gregory-Newton Forward Interpolation method uses the formula 


r(r-l). 2 _ r(r-l)(r-2) . 3^, 
f(x) = f 0 + rAf 0 + J A f 0 + - -rf --A f 0 + .. 


where f 0 is the first value of the data set, Af 0 , A 2 f 0 , and A 3 f 0 are the first, second, and third 
forward differences respectively. The variable r is the difference between an unknown point x 
and a known point x, divided by the interval h, that is, 


( x ~ x i) 

r h 

This formula is valid only when the values x 0 , Xj, x 2 , ..., x n are equally spaced with interval h. 
It is used to interpolate values near the smaller values of x, that is, the values near the begin¬ 
ning of the given data set, hence the name forward interpolation. 
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• The Gregory-Newton Backward Interpolation method uses the formula 

f(x) = f 0 + rAf_ t + r(r * 1) A 2 f_ 2 + r(r + + 2) A 3 f_ 3 + ... 


where f 0 is the first value of the data set, Af_,, A 2 f_ 2 , and A 3 f_ 3 are the first, second and third 
backward differences, and 

_ (x-xQ 


This formula is valid only when the values x 0 , x t , x 2 , x n are equally spaced with interval h. 
It is used to interpolate values near the end of the data set, that is, the larger values of x. Back¬ 
ward interpolation is an expression to indicate that we use the differences in a backward 
sequence, that is, the last entries on the colu mns where the differences appear. 

• If the increments in x values are small, we can use the Excel VLOOKUP function to perform 
interpolation. 

• We can perform interpolation to verify our results with the MATLAB functions 
interp1(x,y,Xi), interp1(x,y,Xi,’method’) where method allows us to specify nearest (nearest 
neighbor interpolation), linear (linear interpolation, the default interpolation), spline (cubic 
spline interpolation which does also extrapolation), cubic (cubic interpolation which requires 
equidistant values of x), and interp2(x,y,z,x i ,y i ) which is similar to interp1(x,y,Xi) but per¬ 
forms two dimensional interpolation; 
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7.10 Exercises 

1. Express the given polynomial f(x) below as a factorial polynomial p(x), calculate the leading 
differences, and then construct the difference table with h = 1. 

f(x) = x 5 - 2x 4 + 4x 3 - x + 6 

2. Use the data of the table below and the appropriate (forward or backward) Gregory-Newton 
formula, to compute: 

a. 7502 

b. J55S 


X 

50 

51 

52 

53 

54 

55 

56 

Vx 

7.071 

7.141 

7.211 

7.280 

7.348 

7.416 

7.483 


3. Use the data of the table below and Newton’s divided difference formula to compute: 

a. f( 1-3) 

b. f( 1.95) 


X 

l.i 

1.2 

1.5 

1.7 

1.8 

2.0 

y=f(x) 

1.112 

1.219 

1.636 

2.054 

2.323 

3.011 
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7.11 Solutions to End-of-Chapter Exercises 
1 . 

f(x) = X 5 - 2x 4 + 4x 3 - x + 6 

The highest power of the given polynomial f(x) is 5, we must evaluate the remainders 
r 0 , r l5 r 2 , r 3 , r 4 and r 5 ; then, we will use (7.28), repeated below, to determine p n (x). 


p n (x) = r 0 + r 1 (x) l ' , + r 2 (xf , + ... + r n _ 1 (xr , + r n (x) 1 " 


We can compute the remainders by long division but, for convenience, we will use the MAT- 
LAB deconv(p,q) function which divides the polynomial p by q. 

The MATLAB script is as follows: 


px=[1 -2 4 0 -1 6]; 
d0=[1 0]; 

[q0,r0]=deconv(px,d0) 
d1=[1 -1]; 

[q1,r1]=deconv(q0,d1) 
d2=[1 -2]; 

[q2,r2]=deconv(q1 ,d2) 
d3=[1 -3]; 

[q3, r3]=deconv(q2 ,d3) 
d4=[1 -4]; 

[q4,r4]=deconv(q3,d4) 
d5=[1 -5]; 

[q5, r5]=deconv(q4, d5) 

q0 = 

1-2 4 

rO = 

0 0 0 

ql = 

1-13 

rl = 

0 0 0 

q2 = 

115 

r2 = 

0 0 0 


% Coefficients of given polynomial 
% Coefficients of first divisor, i.e, x 
% Computation of first quotient and remainder 
% Coefficients of second divisor, i.e, x-1 
% Computation of second quotient and remainder 
% Coefficients of third divisor, i.e, x-2 
% Computation of third quotient and remainder 
% Coefficients of fourth divisor, i.e, x-3 
% Computation of fourth quotient and remainder 
% Coefficients of fifth divisor, i.e, x-4 
% Computation of fifth quotient and remainder 
% Coefficients of sixth (last) divisor, i.e, x-5 
% Computation of sixth (last) quotient and remainder 


0 -1 


0 0 6 


3 

0 2 


13 
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q3 = 

1 4 

r3 = 

0 0 17 

q4 = 

1 

r4 - 

0 8 

q5 = 

0 

r5 = 

1 

Therefore, with reference to (7.28), the factorial polynomial is 

p n (x) = 6 + 2(x) (1) + 13(x) (2) + 17(x) (3) + 8(x) (4) + (x) (5) 

We will verify that p n (x) above is the same polynomial as the given f n (x) by expansion of the 
factorials using (7.12), i.e., 

(x) (n) = x(x — 1) (x — 2)... (x — n + 1) 
with the MATLAB collect(‘s_expr’) function. 

syms x; px=collect((x*(x-1)*(x-2)*(x-3)*(x-4)+(8*x*(x-1)*(x-2)*(x-3))+(17*x*(x-1)*(x-2))+... 

(13*x*(x-1 ))+2*x+6)) 
px = 

x A 5-2*x A 4+4*x A 3-x+6 

We observe that this is the same algebraic polynomial as f(x). 

We will now compute the leading entries for the difference table using (7.30), i.e, 
A J p n (0) = jhj and p n (x) above 

A°p(0) = 0! • 6 = 6 A^O) = 1! • 2 = 2 A 2 p(0) = 2! • 13 = 26 

A 3 p(0) = 3! • 17 = 102 A 4 p(0) = 4! • 8 = 192 A 5 p(0) = 5! • 1 = 120 

A 6 p(0) = 6! • 0 = 0 

We enter these values in the appropriate spaces as shown on the table below. 
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X 

p(x) 

A 

A 2 

A 3 

A 4 

A 5 

A 6 


6 









2 









26 









102 









192 









120 









0 


We obtain the remaining set of values by crisscross addition as shown on the table below. 


X 

p(x) 

A 

A 2 

A 3 

A 4 

A 5 

A 6 


6 









2 







8 


26 







28 


102 





36 


128 


192 





156 


294 


120 



192 


422 


312 


0 



578 


606 


120 



770 


1028 


432 





1606 


1038 





2376 


2066 







3672 







6048 








X 

50 

51 

52 

53 

54 

55 

56 

7i 

7.071 

7.141 

7.211 

7.280 

7.348 

7.416 

7.483 


a. We will use the differences in a forward sequence, that is, the first entries on the columns 
where the differences appear. This is because the value of 750.2 should be in the interval 
50 < x < 51. We enter the given x and f(x) values in a difference table; then, we compute 
the first, second, and third differences. These are not divided differences and therefore, we 
simply subtract the second value of f(x) from the first, the third from the second, and so 
on, as shown below. 
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1st Difference 

2nd Difference 

3rd Difference 

X 

f(x) 

f(x 0 » x t) 

f(x 0 ,x 1 ,x 2 ) 

f(x 0 ,x ls x 2 , x 3 ) 

50 

7.071 

0.070 



51 

7.141 

0.070 

0.000 

-0.001 

52 

7.211 

0.069 

-0.001 

0.000 

53 

7.280 

0.068 

-0.001 

0.001 

54 

7.348 

0.068 

0.000 

-0.001 

55 

7.416 

0.067 

-0.001 


56 

7.483 





f 0 = f(50) = 7.071 
h = Xj -x 0 = 51 -50 = 1 


and with these values, using (7.54), we obtain 

f(50.2) = 7.071 + (0.20) • (7.071) + (°- 20 )' (0- 20 ~ D 

+ (0.20). (0.20- 1K0.20-2) . {Qm) = ? Q85 

The spreadsheet below shows the layout and computations for Part (a). 
Check with MATLAB: 

x =[50 51 52 53 54 55 56]; 
fx=[7.071 7.141 7.211 7.280 7.348 7.416 7.483]; 
spline_interp=interp1(x,fx,[50.2]','spline'); fprintf('\n');... 
fprintf('spline interpolation yields f(50.2) =\n'); disp(splinejnterp) 

spline interpolation yields f(50.2) = 

7.0849 
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Gregory-Newton Forward Interpolation Method for Exercise 7.2(a) 




1 1 1 






See expressions (7.54) and (7.55) 






1 1 






Interpolate f(x) at x= 

50.2 















X 

f(x) 

Af 

A2f 

A3f 

A4f 

A5f 

A6f 


50.0 

7.071 










0.070 







51.0 

7.141 


0.000 








0.070 


-0.001 





52.0 

7.211 


-0.001 


0.001 






0.069 


0.000 


0.000 



53.0 

7.280 


-0.001 


0.001 


-0.003 




0.068 


0.001 


-0.003 



54.0 

7.348 


0.000 


-0.002 






0.068 


-0.001 





55.0 

7.416 


-0.001 








0.067 







56.0 

7.483 

















h= 

A10-A8= 

1.00 

r= 

(D5-A8)/C22= 

0.2 













f(50.2)= 

round(B8+F22*C9+(F20*(F20-1)*D10)/FACT(2)+(F20*(F20-1)*(F20-2)*E11)/FACT(3),3) 


= 

7.085 

















50 

7.071 


f 








51 

7.141 


7.50 -i 

7.40 

7.30 







6 

52 

7.211 





53 

7.280 





54 

7.348 





55 

7.416 


7.20 

7.10 





56 

7.483 















7.00 

5 








0 51 52 53 54 55 5 


















II 1 1 


b. Since the value of J55.9 is very close to the last value in the given range, we will use the 
backward interpolation formula 


f (x) = f 0 + rAf_j + 


r (r + 1) a 2j , r(r+ l)(r + 2) A 3 J? 
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Chapter 7 Finite Differences and Interpolation 


where f 0 is the first value of the data set, Af ,, A f_ 2 , and A f_ 3 are the first, second and 
third backward differences, and 

r = (x ~ x »> 

h 

We arbitrarily choose f 0 = 7.483 as our starting point since f(55.9) lies between f(55) and 
f(56). Then, 

h = 56-55 = 1 

and 

r = (x-xj/h = (55.9 - 56.0)/l = -0.1 
Now, by (7.58) we have: 

f(55.9) = 7.483 + (-0.1)(0.070) + ( ~ 01)( ~ Q - 1 + 1) (0.000) 


. (- 0 - 1 )(- 0.1 + 1 )(- 0.1 + 2 ) 


(-0.001)= 7.476 


Check with MATLAB: 

x =[50 51 52 53 54 55 56]; 
fx=[7.071 7.141 7.211 7.280 7.348 7.416 7.483]; 
spline_interp=interp1 (x,fx,[55.9]','spline'); fprintf('\n');... 
fprintf('spline interpolation yields f(55.9) = \n'); disp(splinejnterp) 

spline interpolation yields f(55.9) = 

7.4764 


X 

l.i 

1.2 

1.5 

1.7 

1.8 

2.0 

y=f(x) 

1.112 

1.219 

1.636 

2.054 

2.323 

3.011 


a. The first divided differences are: 


1 . 2 - 1.1 


2,323-2,054 


1.8 - 1.7 

The second divided differences are: 

1.390- 1.070 


1.5-1.2 
= 2.690 


1.5-1.1 
2.690-2.090 


= 0.800 
= 2.000 


- = 1.390 
3.011-2,323 


1.7- 1.2 
3.440-2.690 


1.7-1.5 
= 3.440 


= 1.400 
= 2.500 
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and the third divided differences are: 


1.400-0,800 
1.7-1.1 


= 1.000 


2,000- 1.400 
1 . 8 - 1.2 


= 1.000 


2,500-2,000 
2.0- 1.5 


= 1.000 


With these values, we construct the difference table below. 




1st Divided 
Difference 

2nd Divided 
Difference 

3rd Divided 
Difference 

X 

f(x) 

flXo^Xj) 

f (x 0 , Xj, x 2 ) 

f(x 0 , x,,x 2 , x 3 ) 

1.1 

1.112 

1.070 



1.2 

1.219 

1.390 

0.800 

1.000 

1.5 

1.636 

2.090 

1.400 

1.000 

1.7 

2.054 

2.690 

2.000 

1.000 

1.8 

2.323 

3.440 

2.500 


2.0 

3.011 





To find f( 1.3). We start with x 0 = 1.1 and for x in (7.49), we use x = 1.3 . Then, 


f(x) = ffXfd + tx-x^ftx^x^ + fx-XoKx-x^ffx^x^) 

+ (x - x 0 )(x - xj)(x - x 2 ) f(x 0 , x,, x 2 , x 3 ) 

f( 1.3) = 1.112 + (1.3 -1.1)(1.07) + (1.3 -1.1)(1.3 —1.2)(1.4) + (1.3 — 1.1)(1.3 — 1.2)(1.3 — 1.5)(1) 

= 1.112 + 0.214 + 0.028-0.004 
= 1.350 

b.To find f( 1.95) we start with x 0 = 2.0 and for x in (7.49), we use x = 1.95 . Then, 

f(x) = f(x 0 ) + (x-x 0 )f(x 0 ,x 1 ) + (x-x 0 )(x-x 1 )f(x 0 ,x 1 ,x 2 ) 

+ (x - x 0 )(x - xj)(x - x 2 ) f(x 0 , x 1; x 2 , x 3 ) 

f(1.95) = 3.011 + (1.95 -2)(3.44) + (1.95 -2)(1.95 - 1.8)(2.5) + (1.95 -2)(1.95 - 1.8)(1.95 - 1.7)(1) 
= 3.011 -0.172-0.019-0.002 
= 2.818 

The spreadsheet below verifies our calculated values. 
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1st divided 

2nd divided 

3rd divided 





difference 

difference 

difference 



X 

f(x) 

f(x0, xl) 

f(x0, xl, x2) 

f(x0,x1,x2,x3) 



1.1 

1.112 








1.070 





1.2 

1.219 


0.800 






1.390 


1.000 



1.5 

1.636 


1.400 






2.090 


1.000 



1.7 

2.054 


2.000 






2.690 


1.000 



1.8 

2.323 


2.500 






3.440 





2.0 

3.011 




















1.1 

1.112 

f 






1.2 

1.219 

3.50 1 





1.5 

1.636 

3.00 




1.7 

2.054 




1.8 

2.323 






2 

3.011 

X 

^ 2 00 











1 50 - 







1 00 






n A Q -1C 'i Q o 






X 













Check with MATLAB: 

x=[ 1.1 1.2 1.5 1.7 1.8 2.0]; 

fx=[ 1.112 1.219 1.636 2.054 2.323 3.011]; 
spline_interp=interp1 (x,fx,[1.3]','spline'); fprintf('\n');... 
fprintf('spline interpolation value of f(1.3): \n\n'); disp(splinejnterp) 

spline interpolation value of f(1.3): 

1.3380 

spline_interp=interp1 (x,fx,[1.95]','spline'); fprintf('\n');... 
fprintf('spline interpolation value of f(1.95): \n\n'); disp(splinejnterp) 

spline interpolation value of f(1.95): 

2.8184 
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Chapter 8 


Linear and Parabolic Regression 


T his chapter is an introduction to regression and procedures for finding the best curve to fit 
a set of data. We will discuss linear and parabolic regression, and regression with power 
series approximations. We will illustrate their application with several examples. 

8.1 Curve Fitting 

Curve fitting is the process of finding equations to approximate straight lines and curves that best 
fit given sets of data. For example, for the data of Figure 8.1, we can use the equation of a straight 
line, that is, 

y = mx + b (8.1) 



For Figure 8.2, we can use the equation for the quadratic or parabolic curve of the form 

y = ax 2 + bx + c (8.2) 


Figure 8.2. Parabolic line approximation 


x 


In finding the best line, we normally assume that the data, shown by the small circles in Figures 
8.1 and 8.2, represent the independent variable x, and our task is to find the dependent variable 
y. This process is called regression. 
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Chapter 8 Linear and Parabolic Regression 


Regression can be linear (straight line) or curved (quadratic, cubic, etc.) and it is not restricted to 
engineering applications. Investment corporations use regression analysis to compare a portfolio’s 
past performance versus index figures. Financial analysts in large corporations use regression to 
forecast future costs, and the Census Bureau use it for population forecasting. 

Obviously, we can find more than one straight line or curve to fit a set of given data, but we inter¬ 
ested in finding the most suitable. 

Let the distance of data point Xj from the line be denoted as d,, the distance of data point x 2 
from the same line as d 2 , and so on. The best fitting straight line or curve has the property that 

d, 2 + d 2 + ... + d 3 = minimum (8.3) 

and it is referred to as the 1 east-squares curve. Thus, a straight line that satisfies (8.3) is called a least 
squares line. If it is a parabola, we call it a least-squares parabola. 

8.2 Linear Regression 

We perform linear regression with the method of least squares. With this method, we compute the 
coefficients m (slope) and b (y-intercept) of the straight line equation 

y = mx + b (8.4) 

such that the sum of the squares of the errors will be minimum. We derive the values of m and b, 
that will make the equation of the straight line to best fit the observed data, as follows: 

Let x and y be two related variables, and assume that corresponding to the values 
Xj, x 2 , x 3 , ..., x n , we have observed the values y 1; y 2 , y 3 , ..., y n . Now, let us suppose that we have 
plotted the values of y versus the corresponding values of x, and we have observed that the 
points (x^ yj), (x 2 , y 2 ), (x 3 , y 3 ), ..., (x n , y n ) approximate a straight line. We denote the straight 
line equations passing through these points as 

y l = mxj +b 
y 2 = mx 2 + b 

y 3 = mx 3 + b (8.5) 

y n = mx n + b 

In (8.5), the slope m and y-intercept b are the same in all equations since we have assumed that 
all points lie close to one straight line. However, we need to determine the values of the unknowns 

m and b from all n equations; we will not obtain valid values for all points if we solve just two 
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equations with two unknowns. 

The error (difference) between the observed value yj, and the value that lies on the straight line, 
is y 1 - (mxj + b). This difference could be positive or negative, depending on the position of the 
observed value, and the value at the point on the straight line. Likewise, the error between the 
observed value y 2 and the value that lies on the straight line is y 2 - (mx 2 + b) and so on. The 
straight line that we choose must be a straight line such that the distances between the observed 
values, and the corresponding values on the straight line, will be minimum. This will be achieved 
if we use the magnitudes (absolute values) of the distances; if we were to combine positive and 
negative values, some may cancel each other and give us an erroneous sum of the distances. 
Accordingly, we find the sum of the squared distances between observed points and the points on 
the straight line. For this reason, this method is referred to as the method of least squares. 

Let the sum of the squares of the errors be 

^squares = [y x - (mxj + b)] 2 + [y 2 - (mx 2 + b)]“ + ... (8.6) 

+ [y n - (mx n + b)] 2 


Since ^squares is a function of two variables m and b, to minimize (8.6) we must equate to 
zero its two partial derivatives with respect to m and b. Then, 


and 


—y 

3m ^ 


squares = - 2x 1 [y 1 - (mxj + b)] - 2x 2 [y 2 - (mx 2 + b)] - ... 


-2x n [y n -(mx n + b)] = 0 


3 

3b 


I 


squares = - 2[y x - (mx x + b)] - 2[y 2 - (mx 2 + b)] - ... 


-2[y n - (mx n + b)] = 0 


(8.7) 


( 8 . 8 ) 


The second derivatives of (8.7) and (8.8) are positive and thus ^squares will have its minimum 
value. 

Collecting like terms, and simplifying (8.7) and (8.8) we obtain 


* A linear system of independent equations that has more equations than unknowns is said to be overdetermined and no 
exact solution exists. On the contrary, a system that has more unknowns than equations is said to be underdetermined and 
these systems have infinite solutions. 
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(Ex 2 )m + (Ex)b = Exy 
(Ex)m + nb = Ey 

where 

Ex = sum of the numbers x 


Ey = sum of the numbers y 

Exy = sum of the numbers of the product xy 


Ex = sum of the numbers x squared 


n = number of data x 

We can solve the equations of (8.9) simultaneously by Cramer’s rule, or with Excel, or with MAT- 
LAB using matrices. 

With Cramer’s rule, m and b are computed from 


where 



( 8 . 10 ) 


A = 

Ex 2 Ex 

Di = 

Exy Ex 

d 2 = 

Ex 2 Exy 

(8.11) 


Ex n 


Ey n 


Ex Ey 



Example 8.1 

In a typical resistor, the resistance R in Q (denoted as y in the equations above) increases with 
an increase in temperature T in °C (denoted as x). The temperature increments and the 
observed resistance values are shown in Table 8-1. Compute the straight line equation that best 
fits the observed data. 


TABLE 8 .1 Data for Example 8.1 - Resistance versus Temperature 


T(C) 

X 

0 

10 

20 

30 

40 

50 

60 

70 

80 

90 

100 

R(Q) 

y 

27.6 

31.0 

34.0 

37 

40 

42.6 

45.5 

48.3 

51.1 

54 

56.7 


Solution: 

There are 11 sets of data and thus n = 11. For convenience, we use the spreadsheet of Figure 8.3 
where we enter the given values and we perform the computations using spreadsheet formulas. 


8-4 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


































Linear Regression 


Spreadsheet for Exam 

pie 8.1 

II 1 1 


x(°C) 

y(£2) 

x 2 

xy 

















0 

27.6 

0 

0 








10 

31.0 

100 

310 



♦ ' 




20 

34.0 

400 

680 


50.0 


, ♦ 





30 

37.0 

900 

1110 

12 40.0 


. *- 





40 

40.0 

1600 

1600 

| 30.0 

. ♦ 






50 

42.6 

2500 

2130 






60 

45.5 

3600 

2730 



n 40 on an 

1( 

)0 



70 

48.3 

4900 

3381 









80 

51.1 

6400 

4088 

, 


leiUJeraiure 





90 

54.0 

8100 

4860 

v - 








100 

56.7 

10000 

5670 







550 

467.8 

38500 

26559 

















Zx 2 

Ex 


38500 

550 








= 



= 

121000 




Zx 

n 


550 

11 













m=D 1 /A= 

0.288 


Exy 

Ex 


26559 

550 








= 



= 

34859 




zy 

n 


467.8 

11 













b=D2/A= 

28.123 


Zx 2 

Zxy 


38500 

26559 








= 



= 

3402850 




Zx 

zy 


550 

467.8 

















Figure 8.3. Spreadsheet for Example 8.1 


Accordingly, we enter the x (temperature) values in Column A, and y (the measured resistance 
corresponding to each temperature value) in Column B. Columns C and D show the x 2 and xy 
products. Then, we compute the sums so they can be used with (8.10) and (8.11). All work is 
shown on the spreadsheet of Figure 8.3. The values of m and b are shown in cells 120 and 124 
respectively. Thus, the straight line equation that best fits the given data is 

y = mx + b = 0.288x + 28.123 (8.12) 


We can use Excel’s Add Trendline feature to produce quick answers to regression problems. We 
will illustrate the procedure with the following example. 
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Chapter 8 Linear and Parabolic Regression 


Example 8.2 

Repeat Example 8.1 using Excel’s Add Trendline feature. 

Solution: 

We first enter the given data in columns A and B as shown on the spreadsheet of Figure 8.4. 



Figure 8.4. Plot of the straight line for Example 8.2 


To produce the plot of Figure 8.4, we perform the following steps: 

1. We click on the Chart Wizard icon. The displayed chart types appear on the Standard Types 
tab. We click on XY (Scatter) Type. On the Chart sub-types options, we click on the top (scat¬ 
ter) sub-type. Then, we click on Next>Next> Next>Finish, and we observe that the plot 
appears next to the data. We click on the Series 1 block inside the Chart box, and we press the 
Delete key to delete it. 

2. To change the plot area from gray to white, we choose Plot Area from the taskbar below the 
main taskbar, we click on the small (with the hand) box, on the Patterns tab we click on the 
white box (below the selected gray box), and we click on OK. We observe now that the plot 
area is white. Next, we click anywhere on the perimeter of the Chart area, and observe six 
square handles (small black squares) around it. We click on Chart on the main taskbar, and on 
the Gridlines tab. Under the Value (Y) axis, we click on the Major gridlines box to deselect it. 

3. We click on the Titles tab, and on the Chart title box, we type Straight line for Example 8.2, on 
the Value X-axis, we type Temperature (degrees Celsius), and on the Value Y-axis, we type Resis¬ 
tance (Ohms). We click anywhere on the x-axis to select it, and we click on the small (with the 
hand) box. We click on the Scale tab, we change the maximum value from 150 to 100, and we 
click OK. We click anywhere on the y-axis to select it, and we click on the small (with the 
hand) box. We click on the Scale tab, we change the minimum value from 0 to 20, we change 
the Major Unit to 10, and we click on OK. 
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Parabolic Regression 


4. To make the plot more presentable, we click anywhere on the perimeter of the Chart area, and 
we observe the six handles around it. We place the cursor near the center handle of the upper 
side of the graph, and when the two-directional arrow appears, we move it upwards by moving 
the mouse in that direction. We can also stretch (or shrink) the height of the Chart area by 
placing the cursor near the center handle of the lower side of the graph, and move it down¬ 
wards with the mouse. Similarly, we can stretch or shrink the width of the plot to the left or to 
the right, by placing the cursor near the center handle of the left or right side of the Chart 
area. 

5. We click anywhere on the perimeter of the Chart area to select it, and we click on Chart above 
the main taskbar. On the pull-down menu, we click on Add Trendline. On the Type tab, we 
click on the first (Linear), and we click on OK. We now observe that the points on the plot 
have been connected by a straight line. 


We can also use Excel to compute and display the equation of the straight line. This feature will 
be illustrated in Example 8.4. The Data Analysis Toolpack in Excel includes the Regression Analysis 
tool which performs linear regression using the least squares method. It provides a wealth of infor¬ 
mation for statisticians, and contains several terms used in probability and statistics. 

8.3 Parabolic Regression 

We find the least-squares parabola that fits a set of sample points with 

y = ax 2 + b + c (8.13) 

where the coefficients a, b, and c are found from 

(Sx 2 )a + (Ex)b + nc= Ey 

(Ex 3 )a + (Ex 2 )b + (Ex)c= Exy (8.14) 

(Ex 4 )a + (Ex 3 )b + (Ex 2 )c= Ex 2 y 
where n = number of data points. 


Example 8.3 

Find the least-squares parabola for the data shown in Table 8.2. 
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TABLE 8.2 Data for Example 8.3 


X 

1.2 

1.5 

1.8 

2.6 

3.1 

4.3 

4.9 

5.3 

y 

4.5 

5.1 

5.8 

6.7 

7.0 

7.3 

7.6 

7.4 

X 

5.7 

6.4 

7.1 

7.6 

8.6 

9.2 

9.8 


y 

7.2 

6.9 

6.6 

5.1 

4.5 

3.4 

2.7 



Solution: 

We construct the spreadsheet of Figure 8.5, and from the data of Columns A and B, we compute 
the values shown in Columns C through G. The sum values are shown in Row 18, and from these 
we form the coefficients of the unknown a, b, and c. 



A 

B 

C 

D 

E 

F 

G 

1 

X 

y 

x 2 

x 3 

X 4 

xy 

x 2 y 

2 

1.2 

4.5 

1.44 

1.73 

2.07 

5.40 

6.48 

3 

1.5 

5.1 

2.25 

3.38 

5.06 

7.65 

11.48 

4 

1.8 

5.8 

3.24 

5.83 

10.50 

10.44 

18.79 

5 

2.6 

6.7 

6.76 

17.58 

45.70 

17.42 

45.29 

6 

3.1 

7.0 

9.61 

29.79 

92.35 

21.70 

67.27 

7 

4.3 

7.3 

18.49 

79.51 

341.88 

31.39 

134.98 

8 

4.9 

7.6 

24.01 

117.65 

576.48 

37.24 

182.48 

9 

5.3 

7.4 

28.09 

148.88 

789.05 

39.22 

207.87 

10 

5.7 

7.2 

32.49 

185.19 

1055.60 

41.04 

233.93 

11 

6.4 

6.9 

40.96 

262.14 

1677.72 

44.16 

282.62 

12 

7.1 

6.6 

50.41 

357.91 

2541.17 

46.86 

332.71 

13 

7.6 

5.1 

57.76 

438.98 

3336.22 

38.76 

294.58 

14 

8.6 

4.5 

73.96 

636.06 

5470.08 

38.70 

332.82 

15 

9.2 

3.4 

84.64 

778.69 

7163.93 

31.28 

287.78 

16 

9.8 

2.7 

96.04 

941.19 

9223.68 

26.46 

259.31 

17 

Xx= 

Ey= 

£x 2 = 

Xx 3 = 

Xx 4 = 

Exy= 

Sx 2 y= 

18 

79.1 

87.8 

530.15 

4004.50 

32331.49 

437.72 

2698.37 


Figure 8.5. Spreadsheet for Example 8.3 


By substitution into (8.14), 


530.15a + 79.1b + 15c= 87.8 

4004.50a + 530.15b + 79.1c= 437.72 (8.15) 

32331.49a + 4004.50b + 530.15c= 2698.37 

We solve the equations of (8.15) with matrix inversion and multiplication, as shown in Figure 8.6. 
The procedure was presented in Chapter 4. 
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A 

B 

1 c 

1 D 

CXI 

rn 

1 G 

1 

Matrix Inversion and Matrix Multiplication for Example 8.3 

2 








3 


530.15 

79.10 

15.00 


£y= 

87.80 

4 

A= 

4004.50 

530.15 

79.10 


2xy= 

437.72 

5 


32331.49 

4004.50 

530.15 


Sx 2 y= 

2698.37 

6 








7 


0.032 

-0.016 

0.002 


a= 

-0.20 

8 

A" 1= 

-0.385 

0.181 

-0.016 


b= 

1.94 

9 


0.979 

-0.385 

0.032 


c= 

2.78 


Figure 8.6. Spreadsheet for the solution of the equations of (8.15) 


Therefore, the least-squares parabola is 

y = - 0.20x 2 + 1.94x + 2.78 
The plot for this parabola is shown in Figure 8.7. 



Figure 8.7. Parabola for Example 8.3 


Example 8.4 

The voltages (volts) shown on Table 8.3 were applied across the terminal of a non-linear device 
and the current ma (milliamps) values were observed and recorded. Use Excel’s Add Trendline 
feature to derive a polynomial that best approximates the given data. 

Solution: 

We enter the given data on the spreadsheet of Figure 8.8 where, for brevity, only a partial list of 
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Chapter 8 Linear and Parabolic Regression 


the given data is shown. However, to obtain the plot, we need to enter all data in Columns A and 
B. 


TABLE 8.3 Data for Example 8.4 


Experimental Data 

Volts 

0.00 

0.25 

0.50 

0.75 

1.00 

1.25 

1.50 

1.75 

2.00 

2.25 

2.50 

ma 

0.00 

0.01 

0.03 

0.05 

0.08 

0.11 

0.14 

0.18 

0.23 

0.28 

0.34 

Volts 

2.75 

3.00 

3.25 

3.50 

3.75 

4.00 

4.25 

4.50 

4.75 

5.00 


ma 

0.42 

0.50 

0.60 

0.72 

0.85 

1.00 

1.18 

1.39 

1.63 

1.91 





1 


Volts 

Amps 

A' . 


■y 




2.00 -i 



y = 0.0182x 3 - 0.0403X 2 + 0.1275x - 0.01771 
R 2 = 0.9997 4 


0.00 

0.00 

1.75 



0.25 

0.01 

1.50 



0.50 

0.03 

1.25 




0.75 

0.05 

1.00 



1.00 

0.08 

0.75 




1.25 

0.11 

0.50 




1.50 

0.14 

0.25 - 




1.75 

0.18 

0.00 




2.00 

0.23 

( 

) 1 2 3 4! 

5 


2.25 

0.28 

v 



2.50 

0.34 




2.75 

0.42 





Figure 8.8. Plot for the data of Example 8.4 


Following the steps of Example 8.2, we create the plot shown next to the data. Here, the smooth 
curve was chosen from the Add trendline feature, but we clicked on the polynomial order 3 on the 
Add trendline Type tab. On the Options tab, we clicked on Display equation on chart, we clicked on 
Display R squared value on chart, and on OK. The quantity R 2 is a measure of the goodness of fit 
for a straight line or, as in this example, for parabolic regression. This is the Pearson correlation coef¬ 
ficient R; it is discussed in probability and statistics textbooks. 


* It is also discussed in Mathematics for Business, Science, and Technology, ISBN 0-9709511-0-8. 
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Parabolic Regression 


The correlation coefficient can vary from 0 to 1. When R 2 = 0, there is no relationship between 
the dependent y and independent x variables. When R 2 = 1, there is a nearly perfect relation¬ 
ship between these variables. Thus, the result of Example 8.4 indicates that there is a strong rela¬ 
tionship between the variables x and y, that is, there is a nearly perfect fit between the cubic 
polynomial and the experimental data. 

With MATLAB, regression is performed with the polyfit(x,y,n) command, where x and y are the 
coordinates of the data points, and n is the degree of the polynomial. Thus, if n = 1, MATLAB 
computes the best straight line approximation, that is, linear regression, and returns the coeffi¬ 
cients m and b. If n = 2, it computes the best quadratic polynomial approximation and returns 
the coefficients of this polynomial. Likewise, if n = 3 , it computes the best cubic polynomial 
approximation, and so on. 

Let p denote the polynomial (linear, quadratic, cubic, or higher order) approximation that is 
computed with the MATLAB polyfit(x,y,n) function. Suppose we want to evaluate the polyno¬ 
mial p at one or more points. We can use the polyval(p,x) function to evaluate the polynomial. If 
x is a scalar, MATLAB returns the value of the polynomial at point x. If x is a row vector, the 
polynomial is evaluated for all values of the vector x. 


Example 8.5 

Repeat Example 8.1 using the MATLAB’s polyfit(x,y,n) function. Use n = 1 to compute the 
best straight line approximation. Plot resistance R versus temperature T in the range 
-10 < T < 110 °C. Use also the polyval(p,x) command to evaluate the best line approximation p 

in the 0 < T < 100 range in ten degrees increments, and compute the percent error (difference 

between the given values and the polynomial values). 

Solution: 

The following MATLAB script will do the computations and plot the data. 

% This is the script for Example 8.5 

% 

T= [ 0 10 20 30 40 50 60 70 80 90 100]; % x-axis data 

R=[27.6 31 34 37 40 42.6 45.5 48.3 51.1 54 56.7]; % y-axis data 

axis([—10 110 20 60]); % Establishes desired x and y axes limits 

plot(T,R,'*b'); % Display experimental (given) points with asterisk 

% and smoothed data with blue line 
grid; title('R (Ohms) vs T (deg Celsius, n=1'); xlabel('T'); ylabel('R'); 
hold % Hold current plot so we can add other data 

p=polyfit(T,R,1); % Fits a first degree polynomial (straight line since n =1) and returns 
% the coefficients m and b of the straight line equation y = mx + b 
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a=0:10:100; % Define range to plot the polynomial 

q=polyval(p,a); % Compute p for each value of a 

plot(a,q) % Plot the polynomial 

% Display the coefficients m and b 
fprintf('\n') % Insert line 

disp('Coefficients m and b are:'); fprintf('\n'); disp(p); 

format bank % Two decimal place display will be sufficient 

disp('Smoothed R values evaluated from straight line are: 1 ); 

R_smoothed=polyval(p,T) % Compute and display the values of the fitted 
% polynomial at same points as given 
% (experimental) values of R 

R_exper = R % Display the experimental values of R for comparison 

% The statement below computes the percent error between 
% the fitted polynomial and the experimental data 
disp('% Error at points of given values is:') 

% The percent error is computed with the following statement 
error=(R_smoothed-R_exper).*100./R_exper 
format short % Return to default format 

The plot for the data of this example is shown in Figure 8.9. 



Figure 8.9. Plot for Example 8.5 
MATLAB also displays the following data: 

Coefficients m and b are: 

0.2881 28.1227 

Smoothed R values evaluated from straight line are: 
R_smoothed = 
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Parabolic Regression 

Columns 1 through 5 
28.12 31.00 33.88 

36.77 39.65 

Columns 6 through 10 
42.53 45.41 48.29 

51.17 54.05 

Column 11 

56.93 


R_exper = 

Columns 1 through 5 
27.60 31.00 34.00 

37.00 40.00 

Columns 6 through 10 
42.60 45.50 48.30 

51.10 54.00 

Column 11 

56.70 



% Error at points of given values is 
error = 


Columns 1 through 5 
1.89 0.01 -0.34 

00 

00 

o 

2 

o 

Columns 6 through 10 
-0.17 -0.20 -0.02 

0.14 0.09 

Column 11 

0.41 



We can make the displayed data more presentable by displaying the values in four columns. The 
following MATLAB script will do that and will display the error in absolute values. 

T= [0 10 20 30 40 50 60 70 80 90 100]; % x-axis data 

R=[27.6 31.0 34.0 37.0 40.0 42.6 45.5 48.3 51.1 54.0 56.7]; % y-axis data 

p=polyfit(T,R,1); R_smoothed=polyval(p,T); R_exper= R; 
error=(R_smoothed-R_exper).*100./R_exper; 

y=zeros(11,4); % Construct an 11 x 4 matrix of zeros 


y(:.i)= T '; 

y(:,2)=R_exper'; 

y(:,3)=R_smoothed'; 

y(:,4)=abs(error)'; 

% 1st column of matrix 
% 2nd column of matrix 
% 3rd column of matrix 
% 4th column of matrix 


fprintf(' \n'); % Insert line 

fprintf('Temp \t Exper R\t Smoothed R \t |Error| \n') 
fprintff \n'); % Insert line 


fprintf('%3.0f\t 

%5.4f\t %5.4f\t %5.4f\n',y') 
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fprintf(' \n'); % Insert line 

When this script is executed, MATLAB displays the following where the error is in percent. 


Temp 

Exper R 

Smoothed 

R |Error| 

0 

27.6000 

28.1227 

1.8939 

10 

31.0000 

31.0036 

0.0117 

20 

34.0000 

33.8845 

0.3396 

30 

37.0000 

36.7655 

0.6339 

40 

40.0000 

39.6464 

0.8841 

50 

42.6000 

42.5273 

0.1707 

60 

45.5000 

45.4082 

0.2018 

70 

48.3000 

48.2891 

0.0226 

80 

51.1000 

51.1700 

0.1370 

90 

54.0000 

54.0509 

0.0943 

100 

56.7000 

56.9318 

0.4089 


8.4 Regression with Power Series Approximations 

In cases where the observed data deviate significantly from the points of a straight line, we can 
draw a smooth curve and compute the coefficients of a power series by approximating the deriva¬ 
tives di/dv with finite differences Ai/Av. The following example illustrates the procedure. 


Example 8.6 

The voltages (volts) shown in Table 8.4, were applied across the terminal of a non-linear device, 
and the current ma (milliamps) values were observed and recorded. Use the power series method 
to derive a polynomial that best approximates the given data. 


TABLE 8.4 Data for Example 8.6 


Experimental Data 

Volts 

0.00 

0.25 

0.50 

0.75 

1.00 

1.25 

1.50 

1.75 

2.00 

2.25 

2.50 

ma 

0.00 

0.01 

0.03 

0.05 

0.08 

0.11 

0.14 

0.18 

0.23 

0.28 

0.34 

Volts 

2.75 

3.00 

3.25 

3.50 

3.75 

4.00 

4.25 

4.50 

4.75 

5.00 


ma 

0.42 

0.50 

0.60 

0.72 

0.85 

1.00 

1.18 

1.39 

1.63 

1.91 



Solution: 

We begin by plotting the given data and we draw a smooth curve as shown in spreadsheet of Fig¬ 
ure 8.10. 
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Experimental 


: 


volts 

ma 



noothed Experimental Data 






Sr 



0.00 

0.00 





0.25 

0.01 


2.00 





0.50 

0.03 


1.80 

/ 




0.75 

0.05 


140 



/ 


1.00 

0.08 


1.20 

/ 




1.25 

0.11 


<o 1.00 



1.50 

0.14 


E 0.80 





y 


1.75 

0.18 


0 40 



2.00 

0.23 


0.20 





— 


2.25 

0.28 


0.00 



2.50 

0.34 


-0.20 





3 1 2 3 4 5 6 

2.75 

0.42 


( 



3.00 

0.50 





3.25 

0.60 





3.50 

0.72 





3.75 

0.85 


From this plot, i | v=0 = i(0) = -0.02 



4.00 

1.00 





4.25 

1.18 





4.50 

1.39 





4.75 

1.63 





5.00 

1.91 












Figure 8.10. Spreadsheet for Example 8.6 


Using the plot of Figure 8.10 we read the voltmeter reading and the corresponding smoothed ma 
readings and enter the values in Table 8.5. 


TABLE 8.5 Data for the first derivative 


Smoothed Data for Computation of Ai / Av 

Volts 

0.00 

0.25 

0.50 

0.75 

1.00 

1.25 

1.50 

1.75 

2.00 

2.25 

2.50 

ma 

-0.02 

0.01 

0.04 

0.06 

0.09 

0.11 

0.14 

0.18 

0.22 

0.27 

0.33 

Volts 

2.75 

3.00 

3.25 

3.50 

3.75 

4.00 

4.25 

4.50 

4.75 

5.00 


ma 

0.41 

0.49 

0.60 

0.72 

0.85 

1.01 

1.20 

1.40 

1.63 

1.89 



Next, we compute Aj/A v for i = 1, 2, ...20 

To facilitate the computations, we enter these values in the spreadsheet of Figure 8.11. In cell E4 
we enter the formula =(B5-B4)/(A5-A4) and we copy it down to E5:E23. 
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Chapter 8 Linear and Parabolic Regression 



A 

B 

c 

D 

E 

1 


Smoothed 



Computed 

2 

Volts 

ma 



Ai / Av 

3 






4 

0.00 

-0.02 

Ai, / Av,= 

(0.01-(-0.02))/(0.25-0.00)= 

0.12 

5 

0.25 

0.01 

Ai 2 / Av 2 = 

(0.04-(0.01 ))/(0.25-0.00)= 

0.12 

6 

0.50 

0.04 



0.08 

7 

0.75 

0.06 



0.12 

8 

1.00 

0.09 



0.08 

9 

1.25 

0.11 



0.12 

10 

1.50 

0.14 



0.16 

11 

1.75 

0.18 



0.16 

12 

2.00 

0.22 



0.20 

13 

2.25 

0.27 



0.24 

14 

2.50 

0.33 



0.32 

15 

2.75 

0.41 



0.32 

16 

3.00 

0.49 



0.44 

17 

3.25 

0.60 



0.48 

18 

3.50 

0.72 



0.52 

19 

3.75 

0.85 



0.64 

20 

4.00 

1.01 



0.76 

21 

4.25 

1.20 



0.80 

22 

4.50 

1.40 



0.92 

23 

4.75 

1.63 

Ai 20 /Av 20 = 

(1.89-(1.63))/(0.25-0.00)= 

1.04 

24 

5.00 

1.89 





Figure 8.11. Spreadsheet for computation of Ai/Av in Example 8.6 


Next, we plot the computed values of Ai/Av versus v and again we smooth the data as shown in 
the spreadsheet of Figure 8.12. The smoothed values of the plot of Figure 8.12 are shown in Figure 
8.13, and from these we compute A‘i/A 2 v. Finally, we plot A 2 i/A 2 v versus volts and again we 
smooth the data as shown in Figure 8.14. 


Following the same procedure we can find higher order derivatives. However, for this example we 
will consider only the first three terms of the polynomial whose coefficients i, Ai/Av and 
Ai 2 /Av 2 , all three evaluated at v = 0 and are read from the plots. Therefore, the polynomial that 
best fits the given data is 

i(v) = i(0) + i (0) + ^-i (0) + ... = -0.02 + 0.12v + 0.5(-0.08)v 2 

2! (8.16) 

= - 0.04v 2 + 0.12v - 0.02 
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Figure 8.12. Plot to obtain smoothed data for Ai/Av in Example 8.6 


Example 8.7 

Repeat Example 8.4 using the MATLAB polyfit(x,y,n) function. Use n = 3 to compute the best 
cubic polynomial approximation. 

Solution: 

With MATLAB, higher degree polynomial regression is also performed with the polyfit(x,y,n) 
function, where n > 2 . In this example we will use n = 3 as we did with Excel. The MATLAB 
script below computes the smoothed line and produces the plot shown on Figure 8.15. 
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A 

B 

c 

D 

E 

1 


Smoothed 



Computed 

2 

Volts 

Ai/Av 



Ai 2 / Av 2 

3 






4 

0.00 

0.12 

Ai 2 , / Av 2 ,= 

(0.11-0.12)/(0.25-0.00)= 

-0.04 

5 

0.25 

0.11 

Ai 2 2 / Av 2 2 = 

(0.10-011)/(0.25-0.00)= 

-0.04 

6 

0.50 

0.10 



0.00 

7 

0.75 

0.10 



0.04 

8 

1.00 

0.11 



0.04 

9 

1.25 

0.12 



0.08 

10 

1.50 

0.14 



0.12 

11 

1.75 

0.17 



0.12 

12 

2.00 

0.20 



0.16 

13 

2.25 

0.24 



0.20 

14 

2.50 

0.29 



0.24 

15 

2.75 

0.35 



0.24 

16 

3.00 

0.41 



0.28 

17 

3.25 

0.48 



0.32 

18 

3.50 

0.56 



0.32 

19 

3.75 

0.64 



0.36 

20 

4.00 

0.73 



0.36 

21 

4.25 

0.82 



0.40 

22 

4.50 

0.92 



0.44 

23 

4.75 

1.03 

Ai 2 2o / Av 2 20 = 

(1.03-0.92)/(0.25-0.00)= 

0.44 

24 

5.00 






Figure 8.13. Spreadsheet for computation of Ai 2 /Av 2 in Example 8.6 


v=[0 0.25 0.5 0.75 1 1.25 1.5 1.75 2 2.25 2.5 2.75 3.... 

3.25 3.5 3.75 4 4.25 4.5 4.75 5]; % x-axis data 

ma=[0 0.01 0.03 0.05 0.08 0.11 0.14 0.18 0.23 0.28.... 

0.34 0.42 0.50 0.60 0.72 0.85 1.00 1.18 1.39 1.63 1.91]; % y-axis data 

axis([-1 6 -1 2]); % Establishes desired x and y axes limits 

plo^v.ma.'+r'); grid % Indicate data points with + and straight line in red 

% 

hold % hold current plot so we can add other data 

disp('Polynomial coefficients in descending order are:') 

% 

p=polyfit(v,ma,3) % Fits a third degree polynomial to 

% the data and returns the coefficients 
% of the polynomial (cubic equation for 
% this example since n=3) 

a=0:0.25:5; % Define range to plot the polynomial 

q=polyval(p,a);% Calculate p at each value of a 
% continued on the next page 
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Figure 8.14. Plot to obtain smoothed data of Ai /Av in Example 8.6 


% 

plot(a,q); title('milliamps vs volts, n=3');... 

xlabel('v'); ylabel('ma') % Plot the polynomial 

% Display actual, smoothed and % error values 

ma_smooth=polyval(p,v); % Calculate the values of the fitted polynomial 

ma_exper = ma; 

% The following statement computes the percent error between the 
% smoothed polynomial and the experimental (given) data 
error=(ma_smooth-ma_exper).*100./(ma_exper+eps); 


y=zeros(21,4); 

y(:,1)=V; 

y(:,2)=ma_exper'; 
y(:,3)=ma_smooth'; 
y(:,4)=abs(error)'; 
fprintf(' \n'); 

% continued on the next page 


% Construct a 21 x 4 matrix of zeros 
% 1st column of matrix 
% 2nd column of matrix 
% 3rd column of matrix 
% 4th column of matrix 
% Insert line 
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Figure 8.15. Plot for Example 8.7 

fprintf('volts \t Exper ma\t Smoothed ma \t |%%Error| \n'); 
fprintff \n'); 

fprintf('%3.2f\t %7.5f\t %7.5f\t %7.5f\n',y') 
fprintff \n'); 

MATLAB computes and displays the following data. 


Polynomial coefficients in descending order are: 
P ^ 


0 . 

.0182 -0. 

.0403 0 

.1275 -0.0177 

volts 

Exper ma 

Smoothed 

ma |%Error| 

0.00 

0.00000 

-0.01766 

7955257388080461.00000 

0.25 

0.01000 

0.01197 

19.74402 

0.50 

0.03000 

0.03828 

27.61614 

0.75 

0.05000 

0.06298 

25.95052 

1.00 

0.08000 

0.08775 

9.69226 

1.25 

0.11000 

0.11433 

3.93513 

1.50 

0.14000 

0.14441 

3.14852 

1.75 

0.18000 

0.17970 

0.16677 

2.00 

0.23000 

0.22191 

3.51632 

2.25 

0.28000 

0.27275 

2.58785 

2.50 

0.34000 

0.33393 

1.78451 

2.75 

0.42000 

0.40716 

3.05797 

3.00 

0.50000 

0.49413 

1.17324 

3.25 

0.60000 

0.59657 

0.57123 
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3.50 

0.72000 

0.71618 

0.53040 

3.75 

0.85000 

0.85467 

0.54911 

4.00 

1.00000 

1.01374 

1.37399 

4.25 

1.18000 

1.19511 

1.28020 

4.50 

1.39000 

1.40048 

0.75362 

4.75 

1.63000 

1.63155 

0.09538 

5.00 

1.91000 

1.89005 

1.04436 


We will conclude this chapter with one more example to illustrate the uses of the MATLAB 

polyfit(x,y,n) and polyval(p,x) functions. 


Example 8.8 
Use MATLAB to 

a. plot the function 

y = sinx/x (8.17) 

in the interval 0 < x < 16 radians. 

b. compute y(0), y(2), y(4), y(6), y(8), y(10), y(12), y(14), y(16) 

c. plot y versus x for these values and use the MATLAB polyfit(x,y,n) and polyval(p,x) func¬ 
tions to find a suitable polynomial that best fits the x and y data. 

Solution: 

a. The fplot function below plots y = sinx/x. We added eps to avoid division by zero. 

fplot('sin(x)./(x+eps)',[0 16 -0.5 1]); grid;... 
title('(sinx)/x curve for x > O') 

The plot for the function of (8.17) is shown in Figure 8.16. 

b. We use the script below to evaluate y at the specified points. 

x=0:2:16; y=sin(x)./(x+eps) 

p7=polyfit(x,y,7); % of x and y with fifth, seventh, 

p9=polyfit(x,y,9); % and ninth degree polynomials 
% continued on the next page 
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Figure 8.16. Plot for Example 8.8 

c. The script for finding a suitable polynomial is listed below. 

x=[0 2 4 6 8 10 12 14 16]; 

y=[1 0.4546 -0.1892 -0.0466 0.1237 -0.0544 -0.0447 0.0708 -0.0180]; 

p5=polyfit(x,y,5); % Fits the polynomial to the data 

x_span=0: 0.1: 16; % Specifies values for x-axis 

p5_pol=polyval(p5, x_span); % Compute the polynomials for this range of x values. 

p7_pol=polyval(p7, x_span); p9_pol=polyval(p9, x_span); 

plot(x_span,p5_pol,'—x_span,p7_pol,'-.', x_span,p9_pol,'-',x,y,'*'); 

% The following two statements establish coordinates for three legends 
% in x and y directions to indicate degree of polynomials 
x_ref=[2 5.3]; y_ref=[1.3,1.3]; 
hold on; 

% The following are line legends for each curve 
plot(x_ref,y_ref,'— , ,x_ref,y_ref-0.2,'-.',x_ref,y_ref-0.4,'-'); 

% The following are text legends for each curve 
text(5.5,1.3, '5th degree polynomial'); 
text(5.5,1.1, '7th degree polynomial'); 
text(5.5,0.9, '9th degree polynomial'); grid; 
hold off 

format short e % Exponential short format 

disp('The coefficients of 5th order polynomial in descending order are:') 

p5_coef=polyfit(x,y,5) 

disp('The coefficients of 7th order polynomial in descending order are:') 
p7_coef=polyfit(x,y,7) 

disp('The coefficients of 9th order polynomial in descending order are:') 
p9_coef=polyfit(x,y,9) 

format short % We could just type format only since it is the default 
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Regression with Power Series Approximations 


The 5th, 7th, and 9th order polynomials are shown in Figure 8.17. 



Figure 8.17. Polynomials for Example 8.8 

The coefficients of the 5th, 7th, and 9th order polynomials are shown below. 
The coefficients of 5th order polynomial in descending order are: 
p5_coef = 

6.5865e-006 -1.4318e-004 -1.5825e-003 

6.0067e-002 -4.6529e-001 1.0293e+000 

The coefficients of 7th order polynomial in descending order are: 
p7_coef = 

Columns 1 through 6 

2.6483e-006 -1.6672e-004 4.1644e-003 

-5.2092e-002 3.3560e-001 -9.9165e-001 

Columns 7 through 8 
7.2508e-001 9.9965e-001 

The coefficients of 9th order polynomial in descending order are: 
p9_coef = 

Columns 1 through 6 

-1.0444e-008 1.1923e-006 -4.8340e-005 

9.5032e-004 -9.7650e-003 4.9437e-002 

Columns 7 through 10 

-8.4572e-002 -1.0057e-001 0 1.0000e+000 
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Chapter 8 Linear and Parabolic Regression 


8.5 Summary 

• Curve fitting is the process of finding equations to approximate straight lines and curves that 
best fit given sets of data. 

• Regression is the process of finding the dependent variable y from some data of the independent 
variable x. Regression can be linear (straight line) or curved (quadratic, cubic, etc.) 

• The best fitting straight line or curve has the property that df + + ... + d 2 = minimum and it 

is referred to as the 1 east-squares curve. A straight line that satisfies this property is called a least 
squares line. If it is a parabola, we call it a least-squares parabola. 

• We perform linear regression with the method of least squares. With this method, we compute 
the coefficients m (slope) and b (y-intercept) of the straight line equation y = mx + b such 
that the sum of the squares of the errors will be minimum. The values of m and b can be found 
from the relations 

(Ex 2 )m + (Ex)b = Exy 
(Ex)m + nb = Ey 

where 

Ex = sum of the numbers x, Ey = sum of the numbers y 

Exy = sum of the numbers of the product xy, Ex = sum of the numbers x squared 
n = number of data x 

The values of m and b are computed from 



where 


A = 

Ex 2 Ex 

D = Sxy Ex D - 

Ex 2 Exy 


Ex n 

| 2y n | 

Ex Ey 


• We find the least-squares parabola that fits a set of sample points with y = ax 2 + b + c where 
the coefficients a, b, and c are found from 

(Ex 2 )a + (Ex)b + nc= Ey 
(Ex 3 )a + (Ex 2 )b + (Ex)c= Exy 
(Ex 4 )a + (Ex 3 )b + (Ex 2 )c= Ex 2 y 
where n = number of data points. 
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Summary 


• With MATLAB, regression is performed with the polyfit(x,y,n) command, where x and y are 
the coordinates of the data points, and n is the degree of the polynomial. Thus, if n = 1, 
MATLAB computes the best straight line approximation, that is, linear regression, and returns 
the coefficients m and b. If n = 2, it computes the best quadratic polynomial approximation 
and returns the coefficients of this polynomial. Likewise, if n = 3 , it computes the best cubic 
polynomial approximation, and so on. 

• In cases where the observed data deviate significantly from the points of a straight line, we can 
draw a smooth curve and compute the coefficients of a power series by approximating the 
derivatives dy/dx with finite differences Ay/Ax. 
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Chapter 8 Linear and Parabolic Regression 
8.6 Exercises 

1. Consider the system of equations below derived from some experimental data. 

2x + y = -1 
x-3y = -4 
x + 4y = 3 
3x-2y = -6 
- x + 2y = 3 
x + 3y = 2 

Using the relations (8.10) and (8.11), find the values of x and y that best fit this system of 
equations. 

2. In a non-linear device, measurements yielded the following sets of values: 


millivolts 

100 

120 

140 

160 

180 

200 

milliamps 

0.45 

0.55 

0.60 

0.70 

0.80 

0.85 


Use the procedure of Example 8.1 to compute the straight line equation that best fits the given 
data. 

3. Repeat Exercise 2 above using Excel’s Trendline feature. 

4 . Repeat Exercise 2 above using the MATLAB’s polyfit(x,y,n) and polyval(p,x) functions. 

5. A sales manager wishes to forecast sales for the next three years for a company that has been in 
business for the past 15 years. The sales during these years are shown on the next page. 
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Exercises 


Year 

Sales 

1 

$9,149,548 

2 

13,048,745 

3 

19,147,687 

4 

28,873,127 

5 

39,163,784 

6 

54,545,369 

7 

72,456,782 

8 

89,547,216 

9 

112,642,574 

10 

130,456,321 

11 

148,678,983 

12 

176,453,837 

13 

207,547,632 

14 

206,147,352 

15 

204,456,987 


Using Excel’s Trendline feature, choose an appropriate polynomial to smooth the given data 
and using the polynomial found, compute the sales for the next three years. You may round 
the sales to the nearest thousand. 

6. Repeat Exercise 5 above using the MATLAB polyfit(x,y,n) and polyval(p,x) functions. 
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Chapter 8 Linear and Parabolic Regression 


8.7 Solutions to End-of-Chapter Exercises 

1. We construct the spreadsheet below by entering the given values and computing the values 
from the formulas given. 



A 

Bj 

LcJ 

\v] 

E 


Lg 

H 

1 

J 

1 

Spreadsheet for Exercise 8.1 




2 











3 


a 

b 

C 

a 2 

ab 

b 2 

ac 

be 


4 











5 


2 

1 

-i 

4 

2 

1 

-2 

-1 


6 


1 

-3 

-4 

1 

-3 

9 

-4 

12 


7 


1 

4 

3 

1 

4 

16 

3 

12 


8 


3 

-2 

-6 

9 

-6 

4 

-18 

12 


9 


-1 

2 

3 

1 

-2 

4 

-3 

6 


10 


1 

3 

2 

1 

3 

9 

2 

6 


11 











12 

X 

7 

5 

-3 

17 

-2 

43 

-22 

47 


13 











14 


Sa 2 

Sab 


17 

-2 





15 

A 



= 



= 

727 



16 


Sab 

Sb 2 


-2 

43 





17 









x=D 1 /A= 

-1.172 

18 


Sac 

Sab 


-22 

-2 





19 

Di 



= 



= 

-852 



20 


Sbc 

Sb 2 


47 

43 





21 









y=D 2 /A= 

1.039 

22 


2a 2 

Sac 


17 

-22 





23 

d 2 



= 



= 

755 



24 


Sab 

Sbc 


-2 

47 






Thus, x = -1.172 and y = 1.039 


8-28 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 








































Solutions to End-of-Chapter Exercises 


2. We construct the spreadsheet below by entering the given values and computing the values 
from the given formulas. 


Spreadsheet for Exercise 8.2 

















x (mV) 

Y(mA) 

x 2 

xy 


A 



• e- ft/I ill iwn Ifo 


A 










100 

0.45 

10000 

45 


1.00 

I 0.80 
^ 0.60 

0.40 

1 




120 

0.55 

14400 

66 






140 

0.60 

19600 

84 




160 

0.70 

25600 

112 




180 

0.80 

32400 

144 






200 

0.85 

40000 

170 




900 

3.95 

142000 

621 


on i?n 140 iso iRi 

1 ?( 

)0 







Millivolts 

































Ex 2 

Ex 


142000 

900 








= 



= 

42000 




Ex 

n 


900 

6 













111=0^= 

0.004 


Exy 

Ex 


621 

900 








A 



= 

171 




zy 

n 


4.0 

6 













b=D 2 /A= 

0.0476 


Ex 2 

Exy 


142000 

621 








= 



= 

2000 




Ex 

zy 


900 

4.0 

















Thus, y = mx + b = 0.004x + 0.0476 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


8-29 






































































Chapter 8 Linear and Parabolic Regression 


3. Following the procedure of Example 8.2, we obtain the trendline shown below. 


Trendline for Exercise 8.3 
















x (mV) 

y(mA) x 2 

xy 


r 





A 










100 

0.45 

10000 

45 


1.00 

I 0.80 




120 

0.55 

14400 

66 





140 

0.60 

19600 

84 




160 

0.70 

25600 

112 





180 

0.80 

32400 

144 


1 1 






200 

0.85 

40000 

170 


0.40 ' 



900 

3.95 

142000 

621 


no 190 i4n loo ifto 900 







Millivolts 






























Zx 2 

Zx 


142000 

900 








= 



= 

42000 




Zx 

n 


900 

6 













m=D 1 /A= 

0.004 


Zxy 

Zx 


621 

900 








= 



= 

171 




zy 

n 


4.0 

6 













b=DyA= 

0.0476 


ZX 2 

Zxy 


142000 

621 








= 



= 

2000 




Zx 

zy 


900 

4.0 

















4 . 


mv= [100 120 140 160 180 200]; 

ma=[0.45 0.55 0.60 0.70 0.80 0.85]; 
axis([100 200 0 1]); 
plot(mv,ma,'*b'); 


% x-axis data 
% y-axis data 

% Establishes desired x and y axes limits 
% Display experimental (given) points with 
% asterisk and smoothed data with blue line 
grid; title('ma (milliamps) vs mv (millivolts, n=1'); xlabel('mv'); ylabel('ma'); 


hold 

p=polyfit(mv,ma,1); 

a=0: 10:200; 

q=polyval(p,a); 

plot(a,q) 

fprintf('\n') 


% Hold current plot so we can add other data 
% Fits a first degree polynomial (straight line since n =1) and returns 
% the coefficients m and b of the straight line equation y = mx + b 
% Define range to plot the polynomial 
% Compute p for each value of a 
% Plot the polynomial 
% Display the coefficients m and b 
% Insert line 
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Solutions to End-of-Chapter Exercises 


disp('Coefficients m and b are: 1 ); fprintf('W); disp(p); 

format bank % Two decimal place display will be sufficient 

ma_smoothed=polyval(p,mv); % Compute the values of the fitted polynomial at 

% same points as given (experimental) values of ma 
ma_exper = ma; % Display the experimental values of ma for comparison 

% The statement below computes the percent error between 
% the fitted polynomial and the experimental data 
% disp('% Error at points of given values is:'); 

% The percent error is computed with the following statement 
error=(ma_smoothed-ma_exper).*100./ma_exper; 
format short % Return to default format 

y=zeros(6,4); % Construct an 6 x 4 matrix of zeros 

y(:,1)=mv'; % 1st column of matrix 

y(:,2)=ma_exper'; % 2nd column of matrix 

y(:,3)=ma_smoothed'; % 3rd column of matrix 

y(:,4)=abs(error)'; % 4th column of matrix 

fprintf(' \n'); % Insert line 

fprintf('mv \t Exper ma\t Smoothed ma\t |Error| percent \n') 
fprintf(' \n'); % Insert line 

fprintf('%3.0f\t %5.4f\t %5.4f\t %5.4f\n',y') 

fprintf(' \n'); % Insert line 

Coefficients m and b are: 


0.0041 0.0476 
mv Exper ma Smoothed 

100 0.4500 0.4548 
120 0.5500 0.5362 
140 0.6000 0.6176 
160 0.7000 0.6990 
180 0.8000 0.7805 
200 0.8500 0.8619 


ma |Error| percent 

1.0582 

2.5108 

2.9365 

0.1361 

2.4405 

1.4006 
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Chapter 8 Linear and Parabolic Regression 


5. Following the procedure of Example 8.4, we choose Polynomial 4 and we obtain the trendline 
shown below. 


1 

2 

3 

4 

5 

6 
7 


9 

10 

11 

12 

13 

14 


9149548 

13048745 

19147687 

28873127 

39163784 

54545369 

72456782 

89547216 

112642574 

130456321 

148678983 

176453837 

207547632 

206147352 


y = -17797X 4 + 436354x 3 - 2E+06x 2 + 

258000000 
208000000 
158000000 
108000000 
58000000 
8000000 

0 5 10 15 20 


1 h+0/x - 2h+U6 

R 2 = 0.9966 



The sales for the next 3 years are from the equation above produced by Excel. 

y 16 = - 17797x 4 + 436354x 3 -2xl0 6 x 2 + 10 7 x-2xl0 6 | x = 16 = 266961792 
y 17 = - 17797x 4 + 436354x 3 -2x 10 6 x 2 + 10 7 x-2x 10 6 | x = 17 = 247383965 
y 18 = - 17797x 4 + 436354x 3 -2xl0 6 x 2 + 10 7 x-2xl0 6 | x = 18 = 206558656 


These results indicate that non-linear interpolation is, in most cases, unreliable. We will 
compare these values with the results of Exercise 6. 


year= [1 2 3 4 5 6 7 8 9 10 11 12 13 14 15]; % x-axis data 

sales=[9149548 13048745 19147687 28873127 39163784 ... 

54545369 72456782 89547216 112642574 130456321 ... 

148678983 176453837 207547632 206147352 204456987]; % y-axis data 

plot(year,sales,'*b'); % Display experimental (given) points with 

% asterisk and smoothed data with blue line 
hold % Hold current plot so we can add other data 

grid; title('Yearly Sales vs Years, n=4'); xlabel('Years'); ylabel('Yearly Sales'); 
p=polyfit(year,sales,4); % Fits a first degree polynomial (n=4) and returns 

% the coefficients of the polynomial 

a=linspace(0,15, 15); % Define range to plot the polynomial 

q=polyval(p,a); % Compute p for each value of a 

plot(a,q) % Plot the polynomial 

% Display coefficients ofpolynomial 
fprintf('\n') % Insert line 

disp('Coefficients are:'); fprintf('W); disp(p); 
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Solutions to End-of-Chapter Exercises 


sales_smoothed=polyval(p,year); % Compute the values of the fitted polynomial at 

% same points as given (experimental) values of ma 
sales_exper = sales; % Display the experimental values of ma for comparison 

% The statement below computes the percent error between 
% the fitted polynomial and the experimental data 
% The percent error is computed with the following statement 
error=(sales_smoothed-sales_exper).*100./sales_exper; 
y=zeros(15,4); % Construct an 15 x 4 matrix of zeros 

y(:,1)=year'; % 1st column of matrix 

y(:,2)=sales_exper'; % 2nd column of matrix 

y(:,3)=sales_smoothed'; % 3rd column of matrix 

y(:,4)=abs(error)'; % 4th column of matrix 

fprintf(' \n'); 

fprintf('year\t Exper sales\t Smoothed sales \t |Error| percent \n') 
fprintf(' \n'); 

fprintf('%2.0f\t %9.0f\t %9.0f\t %5.2f\n',y') 

fprintf(' \n'); 

Coefficients are: 

1.0e+007 * 

-0.0018 0.0436 -0.2386 1.1641 -0.2415 



year Exper sales Smoothed sales |Error| percent 


1 

2 

3 

4 


9149548 

13048745 

19147687 

28873127 


7258461 

14529217 

21374599 

29344934 


20.67 

11.35 

11.63 

1.63 
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Chapter 8 Linear and Parabolic Regression 


5 

39163784 

39563426 

1.02 

6 

54545369 

52726163 

3.34 

7 

72456782 

69102111 

4.63 

8 

89547216 

88533118 

1.13 

9 

112642574 

110433913 

1.96 

10 

130456321 

133792104 

2.56 

11 

148678983 

157168183 

5.71 

12 

176453837 

178695519 

1.27 

13 

207547632 

196080363 

5.53 

14 

206147352 

206601848 

0.22 

15 

204456987 

207111986 

1.30 


From the coefficients produced by MATLAB, shown on the previous page, we form the poly¬ 
nomial 

y = - 1.8 x 10 4 x 4 + 4.36 x 10 5 x 3 - 2.386 x 10 6 x 2 + 1.1641 x 10 7 x - 2.415 x 10 6 
and from it we find the values of y (the yearly sales) as follows: 

x=16; yl 6=-1.8*10 A 4*xM+4.36*10 A 5*x A 3-2.386*10 A 6*x A 2+1.1641 *1 0*7*x-2.41 5*10 A 6; 
x=17; yl 7=-1.8*10 A 4*xM+4.36*10 A 5*x A 3-2.386*10 A 6*x A 2+1.1641 *1 (yV‘x-2.41 5*10 A 6; 
x=18; y 18=-1.8*10 A 4*xM+4.36*10 A 5*x A 3-2.386*10 A 6*x A 2+1.1641 *10*7*x-2.415*10 A 6; 

yl 6, yl 7, y18 

yl6 - 

1.7923e+008 
y!7 = 

1.4462e+008 
yl8 = 

8.7243e+007 

These values vary significantly from those of Exercise 5. As stated above, non-linear interpola¬ 
tion especially for polynomials of fourth degree and higher give inaccurate results. We should 
remember that the equations produced by both Excel and MATLAB represent the equations 
that best fit the experimental values. For extrapolation, linear regression gives the best approx¬ 
imations. 
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Chapter 9 


Solution of Differential Equations by Numerical Methods 


T his chapter is an introduction to several methods that can be used to obtain approximate 
solutions of differential equations. Such approximations are necessary when no exact solu¬ 
tion can be found. The Taylor, Runge-Kutta, Adams’, and Milne’s methods are discussed. 


9.1 Taylor Series Method 

We recall from Chapter 6 that the Taylor series expansion about point a is 

y n = f W = f( a ) + f(a)(x - a) + -^(x - a) 2 + ... + f n , ( ^ (x - a) n (9.1) 

Now, if Xj > a is a value close to a, we can find the approximate value y, of f(x,) by using the 
first k + 1 terms in the Taylor expansion of f(x x ) about x = a. Letting h, = x - a in (9.1), we 
obtain: 

y i = y 0 + y'o h i + jjy"o h ? + j?y'"o h ? + ^y 0 (4)h t + ■ • • (9-2) 

Obviously, to minimize the error f(xj) -y x we need to keep sufficiently small. 

For another value x 2 > Xj, close to x ,, we repeat the procedure with h 2 = x 2 - Xj; then, 


y 2 = yi + y'i h 2 + y;y"i h 2 + Tjy'" h 2 + hyi 4 K 


In general, 


, . 1 „ , 2 1 ,3 1 (4 

y i + 1 = Yi + y i h i + t + TTY i h i + . + Ffy i h i + 1 + TTYi 


(9.3) 


(9.4) 


Example 9.1 

Use the Taylor series method to obtain a solution of 

y' = -xy (9.5) 

correct to four decimal places for values x 0 = 0.0, Xj = 0.1, x 2 = 0.2, x 3 = 0.3, x 4 = 0.4, and 
x 5 = 0.5 with the initial condition y(0) = 1. 
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Chapter 9 Solution of Differential Equations by Numerical Methods 


Solution: 

For this example, 

h = Xj-x 0 = 0.1-0.0 = 0.1 

and by substitution into (9.4), 

y i + ] = Yi + O.ly'j + 0.005y"j + 0.000167y"’j + 0.000004y| 4) (9.6) 


for i = 0, 1,2,3, and 4. 

The first through the fourth derivatives of (9.5) are: 

y' = ~xy 

y" = -xy'-y = - x(-xy) -y = (x 2 -l)y 
y'" = (x 2 -l)y' + 2xy = (x 2 - l)(-xy)2xy = (-x 3 + 3x)y 
y (4) = (- x 3 + 3x)(-xy) + (- 3x 2 + 3)y = (x 4 -6x 2 + 3)y 
We use the subscript i to express them as 

y'i = - x iyi 
y"i = (xf-i)yi 

3 (9-8) 

y"'i = ( _x i + 3x i)yi 

(4) . 4 , 2 

y- = (Xj - 6xj + 3)yj 

where x ; represents x 0 = 0.0, Xj = 0.1, x 2 = 0.2, x 3 = 0.3, and x 4 = 0.4. 

Using the values of the coefficients of y ; in (9.8), we construct the spreadsheet of Figure 9.1. 



Al 

1 B | 

1 C 1 

1 D 

LXJ 

F 

G 

H 

1 

Differential Equation is y' = -xy 




2 

Numerical solution by Taylor method follows 



3 









4 

Xi 

xi 2 

Xi 3 

x 4 

-Xi 

Xj 2 —1 

-Xi 3 +3Xi 

Xi 4 -6Xi 2 +3 

5 









6 

0.0 

0.00 

0.0000 

0.0000 

0.0 

- 1.00 

0.000 

3.0000 

7 

0.1 

0.01 

0.0010 

0.0001 

- 0.1 

- 0.99 

0.299 

2.9401 

8 

0.2 

0.04 

0.0080 

0.0016 

- 0.2 

- 0.96 

0.592 

2.7616 

9 

0.3 

0.09 

0.0270 

0.0081 

- 0.3 

- 0.91 

0.873 

2.4681 

10 

0.4 

0.16 

0.0640 

0.0256 

- 0.4 

- 0.84 

1.136 

2.0656 


Figure 9.1. Spreadsheet for Example 9.1 
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Taylor Series Method 


The values in E6:E10, F6:F10, G6:G10, and H6:H10 of the spreadsheet of Figure 9.1, are now 
substituted into (9.8), and we obtain the following relations: 


y'o 

= - x 0 y 0 = 

O 

II 

0 

O 

y'i 

= - x iyi = 

-o.i Yl 

y ' 2 

= - x 2 y 2 = 

- 0 . 2 Yl 

y '3 

= - x 3 y 3 = 

-0.3 Yi 

y ' 4 

= - x 4 y 4 = 

-0.4 Yi 

y"o = 

( x S-!)y 0 

= -y 0 

y"i = 

( x 5-i)yi 

= -0.99 Yl 

y " 2 = 

( x 2 - i)y 2 

= -0.96y 2 

y " 3 = 

( x 5- l)y 3 

= -0.91y 3 

y " 4 = 

( x J- i)y 4 

= -0.84 Yl 


(9.9) 


(9.10) 


y"o = (- x o + 3x o)yo = 0 
y"i = ( -x i + 3 xj) yi = 0.299 yi 
y "2 = (-x 2 + 3x 2 )y 2 = 0.592y 2 
y's = (- x 3 + 3x 3 )y 3 = 0.873y 3 
y n 4 = (-x 4 + 3x 4 )y 4 = F136y 4 

yo 4) = ( x o - 6 xq + 3)y 0 = 3y 0 
y (4) = (x?-6x? + 3) Yl = 2.9401 Yl 
y ( 4) = (x 2 - 6 x 2 + 3)y 2 = 2.7616y 2 
y 3 4) = ( x 3- 6x 3 + 3 )y 3 = 2.4681y 3 
4 4) = (x 4 - 6 x 4 + 3)y 4 = 2.0656y 4 


(9.11) 


(9.12) 


y4 

By substitution of (9.9) through (9.12) into (9.6), and using the given initial condition y 0 = 1 , 
we obtain: 
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yj = y 0 + 0.1y' 0 + 0.005y" 0 + 0.000167y"o + 0.000004yQ 4) 
= 1 + 0.1(0) + 0.005C-1) + 0.00167(0) + 0.000004(3) 
= 1 -0.005 + 0.000012 
= 0.99501 

Similarly, 

y 2 = Yl + O.ly'j + 0.005y" + 0.000167y"i + 0.000004y ( 1 4) 
= (1 - 0.01 - 0.00495 + 0.00005 + 0.00001 ) Yl 
= 0.98511(0.99501) 

= 0.980194 

y 3 = y 2 + 0.1y' 2 + 0.005y^ + 0.000167y"^ + 0.000004y^ 4) 
= (1 - 0.02 - 0.0048 + 0.0001 + 0.00001 )y 2 
= 0.97531(0.980194) 

= 0.955993 

y 4 = y 3 + 0.1y' 3 + 0.005y" 3 + 0.000167y":, + 0.000004y< 4) 
= (1 - 0.03 - 0.00455 + 0.00015 + 0.00001)y 3 
= 0.9656(0.955993) 

= 0.923107 

y 5 = y 4 + 0.1y'4 + 0.005y" 4 +0.000167y"^ + 0.000004y^ 4) 
= (1 - 0.04 - 0.0042 + 0.00019 + 0.00001 )y 4 
= 0.95600(0.923107) 

= 0.88249 


(9.13) 


(9.14) 


(9.15) 


(9.16) 


(9.17) 


The differential equation ^ = -xy of this example can be solved analytically as follows: 
dx 


^ = -xdx = -fxdx lny = -^x 2 + C 

y J y J 2 

and with the initial condition y = 1 when x = 0, 

lnl s - ~(0) + C C = 0 lny = -|x 2 
or 

y = e -x/2 (9.18) 
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For x 5 = 0.5 (9.18) yields 

y = e“ 0125 = 0.88 25 

and we observe that this value is in close agreement with the value of (9.17). 


We can verify the analytical solution of Example 9.1 with MATLAB’s dsolve(s) function using 
the following script: 

syms x y z 

z=dsolve('Dy=-x*y7y(0)=1','x') 

z - 

exp(-l/2*x / '2) 

The procedure used in this example, can be extended to apply to a second order differential 
equation 

y" = f(x, y, y') (9.19) 

In this case, we need to apply the additional formula 

y'i + 1 = y'i + y"ih +Jjy"' i h 2 +J|y[ 4) h 3 +... (9.20) 


9.2 Runge-Kutta Method 

The Runge-Kutta method is the most widely used method of solving differential equations with 
numerical methods. It differs from the Taylor series method in that we use values of the first 
derivative of f(x, y) at several points instead of the values of successive derivatives at a single 
point. 

For a Runge-Kutta method of order 2, the following formulas are applicable. 


k i = hf ( x n ’ y n ) 

k 2 = hf(x n + h, y n + h) 

y n+ i = y n + |( k i +k 2 ) 

For Runge-Kutta Method of Order 2 


(9.21) 


When higher accuracy is desired, we can use order 3 or order 4. The applicable formulas are as 
follows: 
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1| = hf(x n ,y n ) = kj 


1, = hf x + - 


1 3 = hf (x n + h, y n + 21 2 - lj) 

y n+ i = y n +1 6 (h + 4h+h) 

For Runge-Kutta Method of Order 3 


m i = hf ( x n’ y n ) = 1 1 = k i 
m2 = hf(xn + |,yn + =l) =1 2 


m 3 = hr f x „ + 5 ■ + “f) 
m 4 = hf(x n + h,y n + m 3 ) 

y n +1 = y n + ^( m i + ^ m 2 + ^ m 3 + m d 

For Runge-Kutta Method of Order 4 


(9.22) 


(9.23) 


Example 9.2 

Compute the approximate value of y at x = 0.2 from the solution y(x) of the differential equa¬ 
tion 

y' = x + y 2 (9.24) 

given the initial condition y(0) = 1. Use order 2, 3, and 4 Runge-Kutta methods with h = 0.2 . 

Solution: 

a. For order 2, we use (9.21). Since we are given that y(0) = 1, we begin with x = 0, and 
y = 1. Then, 

k! = hf(x n ,y n ) = 0.2(0 + l 2 ) = 0.2 

k 2 = hf(x n + h,y n + h) = 0.2 [0 + 0.2 + (1 + 0.2 2 )] = 0.328 

and 

yi = y 0 + f Or + k 2 ) = 1 + | (0.2 + 0.328) = 1.264 (9.25) 
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b. For order 3, we use (9.22). Then, 
lj = hf(x n ,y n ) = k, = 0.2 

1 2 = hf (x n + | y n + ^) = 0.2 [(o + ^ • 0.2) + (l + 1 • 0.2) 2 ] = 0.262 (9.26) 

1 3 = hf(x n + h,y n + 21 2 -l 1 ) = 0.2[(0 +0.2) +(1 + 2x0.262-0.2) 2 ] = 0.391 


y, = y 0 + | (li + 41 2 + 1 3 ) = 1 + jj: (0.2 + 4 x 0.262 + 0.391) = 1.273 

c. For order 4, we use (9.23). Then, 

mj = hf(x n ,y n ) s; lj = kj = 0.2 


(9.27) 


m 3 = hf(x n + |,y n + ^) = 0.2[0 + ^ + (l+^)"]= 0.276 
m 4 = hf(x n + h,y n + m 3 ) = 0.2 [0 + 0.2 + (1 + 0.276) 2 ] = 0.366 


(9.28) 


Yl = y 0 + g ( m l + 2m 2 + 2m 3 + m 4) 


(9.29) 


The Runge-Kutta method can also be used for second order differential equations of the form 

y" = f (x, y, y') (9.30) 

For second order differential equations, the pair of 3rd-order formulas are: 


* Third and fourth order formulas can also be used, but these will not be discussed in this text. They can be found in differ¬ 
ential equations and advanced mathematics texts. 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


9-7 







Chapter 9 Solution of Differential Equations by Numerical Methods 


h = hy'n 

I'l = hf(x n ,y n ,y' n ) 

] 2 = h (y’n + y 

V i = hf ( x n+| y n + ^y' n + j) 

1 3 = h (y’ n + 21' 2 - l'j) 

1' 3 = hf(x n + h, y n + 21 2 -l 1 ,y' n + 2r 2 -r i ) 

y n+ i = y n + g( 1 i + 41 2 + 1 3) 

y'n+l = y'n + g( 1 'l +41 '2 + 1 '3) 

For Runge-Kutta Method of Order 3 
2nd Order Differential Equation 


(9.31) 


Example 9.3 

Given the 2nd order non-linear differential equation 

y" - 2y 3 = 0 (9.32) 

with the initial conditions y(0) = 1, y'(0) = -1, compute the approximate values of y and y' at 
x = 0.2. Use h = 0.2. 

Solution: 

We are given the values of x 0 = 0, y 0 = 0, y' 0 = -1 and we are seeking the values of y, and y', 
at Xj = 0.2 . We will use h = x x - x 0 = 0.2 . 

We rewrite the given equation as 

y" = 2y 3 = 0 • x + 2y 3 (9.33) 

and using (9.31) we obtain: 
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h = hy'o = 0.2(-l) = - 0.2 

l't = hf(x 0 ,y 0 ,y' 0 ) = 0.2(0 + 2 x l 3 + 0) = 0.4 

1 2 = h(y'o + y) =0.2(-l + ^) =-0.16 

r 2 = hf (x 0 + \ y 0 + 2 ’ y, o + y) = °- 2 [° + 2 ( 1 + + °] 

= 0.2[2(1-0.1) 3 ] = 0.2(1.458) = 0.2916 

1 3 = h(y' 0 + 21 , 2 -r i ) = 0.2 (-1 +2x0.2916-0.4) = -0.1634 

r 3 = hf ( x o + y 0 + 21 2 - h. y'o + 2r 2 - r i) 

= 0.2 {0 + 2[1 + 2(-0.16) - (-0.2)] 3 + 0} 

= 0.2[2(1 - 0.32 + 0.2) 3 ] = 0.2[2(0.88) 3 ] = 0.2726 
By substitution into the last two formulas of (9.31), we obtain: 

y, = y 0 + ^(h +41 2 + 1 3 ) = 1 + |(- 0.2 + 4(0.16) -0.1634) = 0.8328 
y'j = y' 0 + |(l'i + 41' 2 + 1' 3 ) = - 1 + ^(0.4 + 4(0.2916) + 0.2726) = -0.6935 


(9.34) 


(9.35) 


MATLAB has two functions for computing numerical solutions of Ordinary Differential Equa¬ 
tions (ODE). The first, ode23, uses second and third-order Runge-Kutta methods. The sec¬ 
ond, ode45, uses fourth and fifth-order Runge-Kutta methods. Both have the same syntax; 
therefore, we will use the ode23 function in our subsequent discussion. 

The syntax for ode23 is Ode23(‘f’,tspan,y0). The first argument, f, in single quotation marks, is 
the name of the user defined MATLAB function. The second, tspan, defines the desired time 
span of the interval over which we want to evaluate the function y = f(x). The third argu¬ 
ment, yo. represents the initial condition or boundary point that is needed to determine a 
unique solution. This function produces two outputs, a set of x values and the corresponding set 
of y values that represent points of the function y = f (x). 


Example 9.4 

Use the MATLAB ode23 function to find the analytical solution of the second order nonlinear 
equation 

y" - 2y 3 = 0 (9.36) 
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with the initial conditions y(0) = 1 and y'(0) = -1 . Then, plot the numerical solution using the 
function ode23 for the tspan interval 0 < x < 1 . Compare values with those of Example 9.3, at 
points y(0.2) and y'(0.2). 

Solution: 

If we attempt to find the analytical solution with the following MATLAB script 

syms x y 

y=dsolve('D2y=2*y A 3,y(0)=1 ,Dy(0)=-1 ','x') 

MATLAB displays the following message: 

Warning: Explicit solution could not be found. 

This warning indicates that MATLAB could not find a closed-form solution for this non-linear 
differential equation. This is because, in general, non-linear differential equations cannot be 
solved analytically, although few methods are available for special cases. These can be found in 
differential equations textbooks. 

The numerical solution for this non-linear differential equation is obtained and plotted with the 
following script, by first writing a user defined m-file which we denote as fex9_4. The script is 
shown below. 

function d2y=fex9_4(x,y); 
d2y=[y(2);2*y(1) A 3]; % Output must be a column 

This file is saved as fex9_4. Next, we write and execute the script below to obtain the plots for y 
and y . 

tspan=[0 1]; % Interval over which we want to evaluate y=f(x) 
y0=[1;—1 ]; % Given initial conditions 

[x,y]=ode23('fex9_4', tspan, yO); % Use 2nd and 3rd Order Runge-Kutta 
% Plot numeric values with the statements below 
plot(x, y(:,1), '+r—', x, y(:,2), 'Ob—') 

title('Numerical Solution for Differential Equation of Example 9.4'),... 
xlabel('x'), ylabelfy (upper curve), yprime (lower curve) 1 ), grid 

The plots for y and y' are shown in Ligure 9.2. We observe that the values at points y(0.2) and 
y'(0.2), compare favorably with those that we found in Example 9.3. 
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Example 9.5 

Use MATLAB to find the analytical solution of 

X 2 y"_ X y'_3y = X 2 lnx (9.37) 

with the initial conditions y(l) = -1 and y'( 1) = 0. Then, compute and plot the numerical 
solution using the command ode23 along with points of the analytical solution, to verify the 
accuracy of the numerical solution. 

Solution: 

The analytical solution of (9.37) with the given initial conditions is found with MATLAB as fol¬ 
lows: 

syms x y 

y=dsolve('x A 2*D2y-x*Dy-3*y=x A 2*log(x), Dy(1)=0, y(1)=-1', 'x') 

Y = 

1/9*(-3*x^3*log(x)-2*x A 3-7) /x 

y=simple(y) 

Y = 

(-1/3 * log (x)-2/9) *x / '2-7/9/x 

pretty(y) 

2 

(- 1/3 log(x) - 2/9) x - 7/9 1/x 
and therefore, the analytical solution of (9.37) is 
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r-H'HKs (9 - 38) 

Next, we create and save a user defined m-file, fex9_5. 

function d2y=fex9_5(x,y); % Produces the derivatives of Example 9.5 

% x A 2*y''- x *y' _ 3*y=x A 2*log(x) where y"=2nd der, y'=1st der, logx=lnx 

% 

% we let y(1) = y and y(2)=y', then y(1)'=y(2) 

% 

% and y(2)'=y(2)/x A 2+3*y(1)/x A 2+log(x) 

% 

d2y=[y(2); y(2)/x+3*y(1)/x A 2+log(x)]; % output must be a column 

The following MATLAB script computes and plots the numerical solution values for the interval 
1 < x < 4 and compares these with the actual values obtained from the analytical solutions. 

tspan=[1 4]; % Interval over which we want to evaluate y=f(x) 
y0=[—1 ;0]; % Given initial conditions 

[x,y]=ode23('fex9_5', tspan, yO); % Use 2nd and 3rd Order Runge-Kutta 
anal_y=((-1./3).*log(x)-2./9).*x. A 2-7./(9.*x); %This is the... 

% analytic solution of the 2nd order differential equation of (9.38) 
anal_yprime=((-2./3).*log(x)-7./9).*x+7./(9.*x. A 2); % This is the first derivative of (9.38) 

% Plot numeric and analytic values with the statements below 
plot(x, y(:,1),x, anal_y,x, y(:,2), 'O', x, anaLyprime,'-'),... 
title('Numeric and Analytic Solutions of Differential Equation of Example 9.5'),... 
xlabel('x'), ylabelfy (line with +), yprime (line with O) 1 ), grid 

The numeric and analytical solutions are shown in Figure 9.3. 



Figure 9.3. Plot for Example 9.5 
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9.3 Adams’ Method 

In this method, the step from y n to y n + , is performed by a formula expressed in terms of differ¬ 
ences of f (x, y). 

Adams’ method uses the formula 


yn + , = yn+i>[f n+ i4f n+ ^4 2 f n+ |4 3 f n+ ...] 

where 

h - x n+1 -x n 
f n = ( x n’ Yn) 

Af n = 


(9.39) 


A 2 f n = Af n -Af n _ 1 

and so on. 

Obviously, to form a table of differences, it is necessary to have several (4 or more) approximate 
values of y(x) in addition to the given initial condition y(0). These values can be found by 
other methods such as the Taylor series or Runge-Kutta methods. 


Example 9.6 

Given the differential equation 

y' = 2y + x (9.40) 

with the initial condition y(0) = 1 , 

compute the approximate values of y for x = 0.1, 0.2, 0.3, 0.4 and 0.5 by the third-order 
Runge-Kutta method. Then, find the value of y corresponding to x = 0.6 correct to three dec¬ 
imal places using Adams’ method. 

Solution: 

The spreadsheet of Figure 9.4 shows the results of the computations of y 1; y 2 , y 3 , y 4 , and y 5 
using the third-order Runge-Kutta method as in Example 9.2. 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


9-13 







Chapter 9 Solution of Differential Equations by Numerical Methods 



A | B 

c 

D 

E 

F 

1 

Differential Equation y' = x + 2y 





2 

Numeric 

al solution by Runga-Kutte mi 

sthod follows 




4 

h= 

x(1)-x(0)= 

0.1000 


Xo= 

0.0 

b 

x(0)= 

(given) 

0.0000 


Xi= 

0.1 

6 

y(Q)= 

Initial condition (given) 

1.0000 


x 2 = 

0.2 

/ 





X 3 = 

0.3 

8 





x 4 = 

0.4 

y 

L(1)= 

h*f(x n ,y n ) 

h*(0+2*1)= 

0.2000 

X 5 = 

0.5 

10 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h)+2*(1 +0.5*L(1 ))]= 

0.2250 



ii 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h)+2*(1+2*L(2)-L(1))]= 

0.2600 



13 

y(i)= 

y(0) + (L(1) + 4*L(2) + L(3))/6 


1.2267 



15 

h= 

x(2)-x(1)= 

0.1000 




16 

x (0.1)= 

Next value x(0) + h 

0.1000 




17 

y(1)= 

From previous computation 

1.2267 




19 

L(1)= 

h*f(x n ,y n ) 

h*(0.1+2*1.2267)= 

0.2553 



20 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h)+2*(1 +0.5*L(1 ))]= 

0.2859 



21 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h)+2*(1+2*L(2)-L(1))]= 

0.3286 










23 

y(2)= 

y(1)+(L(1) + 4*L(2) + L(3))/6 


1.5146 



25 

h= 

x(2)-x(1)= 

0.1000 




26 

x(0.2)= 

Next value x(0) + 2*h 

0.2000 




27 

y(2)= 

From previous computation 

1.5146 




29 

L(1)= 

h*f(x„,y n ) 

h*(0.2+2*1.5146)= 

0.3229 



30 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h)+2*(1 +0.5*L(1 ))]= 

0.3602 



31 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h)+2*(1 +2*L(2)-L(1 ))]= 

0.4124 










33 

y(3)= 

y(2) + (L(1) + 4*L(2) + L(3))/6 


1.8773 



35 

h= 

x(3)-x(2)= 

0.1000 




36 

x(0.3)= 

Next value x(0) + 3*h 

0.3000 




37 

y(3)= 

From previous computation 

1.8773 




39 

L(1)= 

h*f(x n ,y n ) 

h*(0.3+2*1.8773)= 

0.4055 



40 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h)+2*(1 +0.5*L(1 ))]= 

0.4510 



41 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h)+2*(1 +2*L(2)-L(1 ))]= 

0.5148 



43 

y(4)= 

y(2) + (L(1) + 4*L(2) + L(3))/6 


2.3313 



45 

h= 

x(4)-x(3)= 

0.1000 




46 

x(0.4)= 

Next value x(0) + 4*h 

0.4000 




47 

y(4)= 

From previous computation 

2.3313 




49 

L(1)= 

h*f(x n ,y n ) 

h*(0.3+2*1.8773)= 

0.5063 



50 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h)+2*(1 +0.5*L(1 ))]= 

0.5619 



bl 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h)+2*(1 +2*L(2)-L(1 ))]= 

0.6398 



53 

y(5)= 

y(2) +(L(1) + 4*L(2) + L(3))/6 


2.8969 




Figure 9.4. Spreadsheet for Example 9.6 
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Milne’s Method 


Next, we compute the following values to be used in Adams’ formula of (9.39). These are shown 
below. 

x n y n f n =x n +2y n Af n A 2 f n A 3 f n 


0.0 1.0000 

0.1 1.2267 

0.2 1.5146 

0.3 1.8773 

0.4 2.3313 

0.5 2.8969 


2.0000 

2.5534 

3.2292 

4.0546 

5.0626 

6.2938 


0.5534 

0.1224 

0.6758 0.0272 

0.1496 

0.8254 0.0330 

0.1826 

1.0080 0.0406 

0.2232 

1.2312 


and by substitution into (7.39) 

y 6 = 2.8969 + 0.1 ^6.2638 + |(1.2312) + ^(0.2232) + |(0.0406)] = 3.599 (9.41) 


As with the other methods, Adams’ method can also be applied to second order differential 
equations of the form y" = f(x, y, y') with initial conditions y(x 0 ) = y 0 and y'(x 0 ) = yj,. 


9.4 Milne’s Method 

Milne’s method also requires prior knowledge of several values of y. It uses the predictor-cor¬ 
rector pair 


y n+ l = yn-3 + | h l 2f n- f n-l + 2f n-2] 

and 


(9.42) 


(9.43) 


The corrector formula of (9.43) serves as a check for the value 

y n+1 = f(x n+ 1 ,y n + 1 ) 


(9.44) 


If y n + j and Y n + { in (9.42) and (9.43) respectively, do not differ considerably, we accept Y n + { 
as the best approximation. If they differ significantly, we must reduce the interval h. 
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Example 9.7 

Use Milne’s method to find the value of y corresponding to x = 0.6 for the differential equation 
y' = 2y + x (9.45) 

with the initial condition y(0) = 1. 

Solution: 

This is the same differential equation as in Example 9.6 where we found the following values: 


TABLE 9.1 Table for Example 9 .7 


n 

x„ 

y„ 

f=x n +2y n 

2 

0.2 

1.5146 

3.2292 

3 

0.3 

1.8773 

4.0546 

4 

0.4 

2.3313 

5.0626 

5 

0.5 

2.8969 

6.2938 


and using the predictor formula we find 

y 6 = y 2 + |(0.1)[2f 5 -f 4 + 2f 3 ] 

= 1.5146 +1 x 0.1(2 x 6.2938 - 5.0626 + 2 x 4.0546) = 3.599 


(9.46) 


Before we use the corrector formula of (9.43), we must find the value of f 6 ; this is found from 


f 6 = x 6 + 2 Y6 


where x 6 = 0.6 , and from Example 9.5 y 6 = 3.599 . Then, 


and 


f 6 = x 6 + 2y 6 = 0.6 + 2x 3.599 = 7.7984 


Y 6 = y 4 + ^0.1(f 6 + 4f 5 + f 4 ) 

= 2.3313 + ^ x 0.1(7.7984 + 4 x 6.2938 + 5.0626) = 3.599 


(9.47) 


We see from (9.46) and (9.47) that the predictor-corrector pair is in very close agreement. 


Milne’s method can also be extended to second order differential equations of the form 
y" = f(x, y, y') with initial conditions y(x 0 ) = y 0 and y'(x 0 ) = yjj. 
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Summary 


9.5 Summary 

• The Taylor series method uses values of successive derivatives at a single point. We can use 
this series method to obtain approximate solutions of differential equations with the relation 


y i+ i = yi + y'i h i + i + , + jprrf .. + iiA A. + 


provided that h is sufficiently small such as h = 0.1. 

• The Taylor series method can also be extended to apply to a second order differential equa¬ 
tion 

y" = f (x, y, y') 

using the relation 

, , ,, , 1 ,2 1 (4), 3 

y' i + 1 = Yi + yi h + jjy ^ + ^yl h +... 


• The Runge-Kutta method uses values of the first derivative of f(x, y) at several points, it is 
the most widely used method of solving differential equations using numerical methods. 

• For a Runge-Kutta method of order 2 we use the relations 

k t = hf(x n ,y n ) k 2 = hf(x n + h,y n + h) Y n + l = Y n + |( k i +k 2) 


provided that h is sufficiently small such as h = 0.1. 

• For a Runge-Kutta method of order 3 we use the relations 

It = hf (x n , y n ) = k, 1 2 = hf fx n + y n + 1 3 = hf (x n + h, y n + 21 2 - lj) 

Yn + l = Yn+gOi+^ + ls) 

• For a Runge-Kutta method of order 4 we use the relations 

m l = hf ( x n’Yn) = ll = k l m 2 = hf ( x n + |’y n + y) = l 2 

m 3 = hf (^x n + , y n + m 4 = hf (x n + h, y n + m 3 ) 

Yn+i = y n + ^m 1+ 2m 2 + 2m 3 + m 4 ) 

• The Runge-Kutta method can also be used for second order differential equations of the 
form 
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y" = f(x, y, y') 

• For second order differential equations, the pair of 3rd-order relations are: 


h = hy'n f'l = hf ( x n’ y n > y'n) 




y n + y n 


1 3 = h (y' n + 21' 2 - l'j) 1' 3 = hf(x n + h, y n + 21 2 - l l5 y' n + 21' 2 - l'j) 

y n+ i = yn+lch + ^+h) y'n+i = y'n+^'i+^Ws) 


Third and fourth order formulas can also be used but they were not be discussed in this text. 
They can be found in differential equations texts. 

• MATLAB has two functions for computing numerical solutions of Ordinary Differential Equa¬ 
tions (ODE). The first, ode23, uses second and third-order Runge-Kutta methods. The sec¬ 
ond, ode45, uses fourth and fifth-order Runge-Kutta methods. Both have the same syntax. 

• The syntax for ode23 is Ode23(‘f’,tspan,y0). The first argument, f, in single quotation marks, 
is the name of the user defined MATLAB function. The second, tspan, defines the desired 
time span of the interval over which we want to evaluate the function y = f(x). The third 
argument, yo. represents the initial condition or boundary point that is needed to determine a 
unique solution. This function produces two outputs, a set of x values and the corresponding 
set of y values that represent points of the function y = f (x). 

• Adams’ method provides the transition from y n to y n + , and the step is performed by a for¬ 
mula expressed in terms of differences of f(x, y). This method uses the formula 


y n+ i 


f n = (V y n ) 

Af n = f n -f n _! 

A 2 f n = Af n - Af n _ j 

and so on. To use this method, it is necessary to have several (4 or more) approximate values of 
y(x) in addition to the given initial condition y(0). These values can be found by other meth¬ 
ods such as the Taylor series or Runge-Kutta methods. 
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Summary 

• Milne’s method also requires prior knowledge of several values of y. It uses the predictor-cor¬ 
rector pair 

y n+ l = yn-3 + | h [ 2f n- f n-l +2f n- 2 ] 

and 

Y n + 1 = y n -l + ^ h [ f n + l +4f n + f n-l] 

where y n + { is the predictor formula and Y n + ] is the corrector formula. The corrector for¬ 
mula serves as a check for the value 

y n + 1 = f(x n + 1 ,y n + 1 ) 

If y n + j and Y n + j do not differ considerably, we accept Y n + ( as the best approximation. If 
they differ significantly, we must reduce the interval h. 

Milne’s method can also be extended to second order differential equations of the form 
y" = f(x, y, y') with initial conditions y(x 0 ) = y 0 and y'(x 0 ) = y' 0 . The procedure for this 
method was not discussed. It can be found in differential equations texts. 
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9.6 Exercises 

1. Use the MATLAB ode23 function to verify the analytical solution of Example 9.1. 

2. Construct a spreadsheet for the numerical solutions of Example 9.2. 

3. Use MATLAB to find the analytical solution of 

y ' = f( x ) = 3x 2 

with the initial condition y(2) = 0.5 . Then, compute and plot the numerical solution using 
the MATLAB function ode23 along with points of the analytical solution to verify the accu¬ 
racy of the numerical solution for the interval 2 < x < 4 . 

4. Use MATLAB to plot the numerical solution of the non-linear differential equation 

y' - -y 3 + 0.2sinx 

with the initial condition y(0) = 0.707 using the command ode23 for the interval 0 < x < 10. 

5. Given the differential equation 

i 2 

y = x -y 

with the initial condition y(0) = 1 and x 0 = 0.0 find the values of y corresponding to the 
values of x 0 + 0.1 and x 0 + 0.2 correct to four decimal places using the third-order Runge- 
Kutta method. It is suggested that a spreadsheet is used to do all computations. 

6. Given the differential equation 

y" + y' = xy 

compute the approximate values of y and y' at x 0 + 0.1 and x 0 + 0.2 given that y(0) = 1, 
y'(0) = -1 , and x 0 = 0.0 correct to four decimal places, using the third-order Runge-Kutta 
method. It is suggested that a spreadsheet is used to do all computations. 
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9.7 Solutions to End-of-Chapter Exercises 
1 . 

We write and save the following function file: 

function dy = func_exer9_1 (x,y) 
dy = -x*y; 

Next, we write and execute the MATLAB script below. 

tspan=[0 3]; % Interval over which we want to evaluate y=f(x) 
y0=[1;—1 ]; % Given initial conditions 

[x,y]=ode23('func_exer9_1', tspan, yO); % Use 2nd and 3rd Order Runge-Kutta 
% Plot numeric values with the statements below 
plotfx, y(:,1), '+r-', x, y(:,2), 'Ob—') 

titlef'Numeric Solution of Differential Equation of Exercise 9.1'),... 
xlabel('x'), ylabelf'y (upper curve), yprime (lower curve)'), grid 

The plot below shows the function y = f(x) and its derivative dy/dx. 
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2 . 



A | B 

C 

D 

1 

Differential Equation y' = x + y 2 



2 

Numerical solution by Runga-Kutte method follows 



3 





4 

h= 

(given) 

0.2000 


5 

x(0)= 

(given) 

0.0000 


6 

y(o)= 

Initial condition (given) 

1.0000 


7 





8 

k(i)= 

h*f(Xn,y n ) 

h*(0+1 A 2)= 

0.2000 

9 

k(2)= 

h*f(x n +h,y n +h) 

h*(0+0.2+(1 +0.2) A 2)= 

0.3280 

10 

y(i)= 

y(0)+0.5(k(1)+k(2)) 

y(0)+0.5*(D11+D12) 

1.2640 

11 





12 

L(1)= 

h*f(Xn,y n ) 

h*(0+1 A 2)= 

0.2000 

13 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h)+(1+0.5*L(1) A 2)]= 

0.2620 

14 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h)+(1 +2*L(2)-L(1 )) A 2]= 

0.3906 

15 

y(1)= 

y(0) + (L(1) + 4*L(2) + L(3))/6 


1.2731 

16 





17 

m(1)= 

h*f(x„,yn) 

h*(0+1 A 2)= 

0.2000 

18 

m(2)= 

h*f(x n +0.5*h,y n +0.5*m(1)) 

h*[(0+0.5*h)+(1 +0.5*m(1 )) A 2]= 

0.2620 

19 

m(3)= 

h*f(x n +0.5*h,y n +0.5*m(2)) 

h*[(0+0.5*h)+(1 +0.5*m(2)) A 2]= 

0.2758 

20 

m(4)= 

h*f(x n +h,y n +m(3)) 

h*[(0+h)+(1 +m(3)) A 2]= 

0.3655 

21 

y(1)= 

y(0) +(1/6)*(m(1) + 2*m(2)+2*m(3) + m(4)) 


1.2735 


The analytical solution is found with 
syms x y 

y=dsolve('Dy=3*x A 2,y(2)=0.5','x') 
and MATLAB displays 
y ^ 

x A 3-15/2 

Next, we write and save the following statements as function file fexer9_3 

function Dy=fexer9_3(x,y); 

Dy=3*x A 2; 

The MATLAB script for the numerical solution is as follows: 

tspan=[2 4]; % Interval over which we want to evaluate y=f(x) 

y0=7.5; % Initial condition: Since y=x A 3-15/2 and y(2) = 0.5, it follows that y(0) = 7.5 

[x,y]=ode23('fexer9_3', tspan, yO); % Use 2nd and 3rd Order Runge-Kutta 

% Plot numeric values with the statements below 

plot(x, y, '+r-') 

title('Numeric Solution of Differential Equation of Exercise 9.3'),... 
xlabel('x'), ylabel('y'), grid 
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Solutions to End-of-Chapter Exercises 



4. 


We write and save the following statements as function file fexer4 

function Dy=fexer4(x,y); 

Dy=-y A 3+0.2*sin(x); 

The MATLAB script and the plot for the numerical solution are as follows: 

tspan=[0 10]; x0=[0.707]; 

[x,num_x]=ode23('fexer4',tspan,x0); plot(x,num_x,'+ l , x,num_x, 
title('Numeric solution of non-linear differential equation dy/dx=-x A 3+0.2sinx'),... 
xlabel('x'), ylabel('y=f(x)'), grid 



5. The spreadsheet is shown on the following two pages. 
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A | B 

C 

D 

E 

F 

1 

Differential Equation is y' = x 2 - y 





2 

Numerical solution by Runga-Kutte method follows 




3 







4 

h= 

x(1)-x(0)= 

0.1000 


x 0 = 

0.0 

5 

x(0)= 

(given) 

0.0000 


Xi = 

0.1 

6 

y(0)= 

Initial condition (given) 

1.0000 


x 2 = 

0.2 

7 







8 







9 

L(1)= 

h*f(x n ,y n ) 

h*(0-1)= 

-0.1000 



10 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h) A 2-(1 +0.5*L(1 ))]= 

-0.0948 



11 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h) A 2-(1 +2*L(2)-L(1 ))]= 

-0.0901 



12 







13 

y(i)= 

y(0) + (L(1) + 4*L(2) + L(3))/6 


0.9052 



14 







15 

h= 

x(2)-x(1)= 

0.1000 




16 

x (0.1)= 

Next value x(0) + h 

0.1000 




17 

y(i)= 

From previous computation 

0.9052 




18 







19 

L(1)= 

h*f(x n ,y n ) 

h*(0.1 A 2-0.9052)= 

-0.0895 



20 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h) A 2-(0.9052+0.5*L(1))]= 

-0.0838 



21 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0.1 +h) A 2-(0.9052+2*L(2)-L(1 ))]= 

-0.0787 



22 







23 

y(2)= 

y(1) + (L(1) + 4*L(2) + L(3))/6 


0.8213 



24 







25 

h= 

x (2)-x(1)= 

0.1000 




26 

x (0.2)= 

Next value x(0) + 2*h 

0.2000 




27 

y(2)= 

From previous computation 

0.8213 




28 







29 

L(1)= 

h*f(x n ,y n ) 

h*(0.2+2*1.5146)= 

0.1843 



30 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h)+2*(1 +0.5*L(1 ))]= 

0.2077 



31 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h)+2*(1+2*L(2)-L(1))]= 

0.2405 



32 







33 

y(3)= 

y(2) + (L(1) + 4*L(2) + L(3))/6 


1.0305 



34 







35 

h= 

x (3)-x(2)= 

-0.2000 




36 

x (0.3)= 

Next value x(0) + 3*h 

-0.6000 




37 

y(3)= 

From previous computation 

1.0305 




38 







39 

L(1)= 

h*f(x n ,y n ) 

h*(0.3+2*1.8773)= 

-0.2922 



40 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h)+2*(1+0.5*L(1))]= 

-0.2138 



41 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h)+2*(1+2*L(2)-L(1))]= 

-0.1981 



42 







43 

y(4)= 

y(2) + (L(1) + 4*L(2) + L(3))/6 


0.8063 




continued on next page 
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A 

B 

C 

D 

E 

F 

44 







45 

h= 

x (4)-x(3)= 

0.0000 




46 

x(0.4)= 

Next value x(0) + 4*h 

0.0000 




47 

y(3)= 

From previous computation 

0.8063 




48 







49 

L(1 )= 

h*f(x n ,y„) 

h*(0.3+2*1.8773)= 

0.0000 



50 

L(2)= 

h*f(x n +0.5*h,y n +0.5*L(1)) 

h*[(0+0.5*h)+2*(1 +0.5*L(1 ))]= 

0.0000 



51 

L(3)= 

h*f(x n +h,y n +2*L(2)-L(1)) 

h*[(0+h)+2*(1+2*L(2)-L(1))]= 

0.0000 



52 







53 

y(4)= 

y(2) + (L(1) + 4*L(2) + L(3))/6 


0.8063 




6 . 



A 

B 

C 

1 

Differential Equation is y"+y'=xy or y M =xy-y' 


2 

Numerical solution by Runga-Kutte method follows 


3 




4 

h= 

x(1)-x(0)= 

0.1000 

5 

x(0)= 

Initial condition (given) 

0.0000 

6 

y(Q)= 

Initial condition (given) 

1.0000 

7 

y'(0)= 

Initial condition (given) 

-1.0000 

8 




9 

L(1)= 

h*y'(0)= 

-0.1000 

10 

L'(1)= 

h*f(x(0), y(0), y'(0))= 

0.1000 

11 

L(2)= 

h*(y'(0) + 0.5‘L'(1))= 

-0.0950 

12 

L'(2)= 

h‘f(x(0) + 0.5‘h, y(0) + 0.5‘L(1), y'(0) + 0.5‘L(1))= 

0.0998 

13 

L(3)= 

h*(y'(0) + 2*L'(2) - L'(1 ))= 

-0.0901 

14 

L'(3)= 

h*f(x(0) + h, y(0) + 2*L(2) - L(1), y'(0) + 2*L'(2) - L'(1))= 

0.0992 

15 




16 

y(1)= 

y(0) +(L(1) + 4*L(2) + L(3))/6 

0.9050 

17 

y'(1)= 

y'(0) + (L'(1) + 4*L'(2) + L'(3))/6= 

-0.9003 

18 




19 

h= 

x(1)-x(0)= 

0.1000 

20 

x(0.1)= 

Next value x(0) + h 

0.1000 

21 

y(1)= 

From previous computation 

0.9050 

22 

y'(1)= 

From previous computation 

-0.9003 

23 





continued on next page 
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A 

B 

C 

24 

L(1)= 

h*y'(1 )= 

-0.0900 

25 

L’(1)= 

h‘f(x(1), y(1), y'(1))= 

0.0991 

26 

L(2)= 

h*(y'(1) + 0.5*L'(1))= 

-0.0851 

27 

L'(2)= 

h*f(x(1) + 0.5*h, y(1) + 0.5*L(1), y'(1) + 0.5‘L'(1))= 

0.0980 

28 

L(3)= 

h*(y'(1) + 2*L'(2) - L'(1 ))= 

-0.0803 

29 

L'(3)= 

h*f(x(1) + h, y(1) + 2*L(2) - L(1), y'(1) + 2*L'(2) - L'(1 ))= 

0.0968 

30 




31 

y(2)= 

y(0) + (L(1) + 4*L(2) + L(3))/6 

0.8199 

32 

y'(2)= 

y'(0) + (L'(1) + 4*L'(2) + L'(3))/6= 

-0.8023 

33 




34 

h= 

x(2)-x(1)= 

0.1000 

35 

x (0.2)= 

Next value x(0) + 2*h 

0.2000 

36 

y(2)= 

From previous computation 

0.8199 

37 

y'(2)= 

From previous computation 

-0.8023 

38 




39 

L(1)= 

h*y'(0)= 

-0.0802 

40 

L'(1)= 

h*f(x(0), y(0), y'(0))= 

0.0966 

41 

L(2)= 

h*(y'(0) + 0.5*L'(1))= 

-0.0754 

42 

L'(2)= 

h*f(x(0) + 0.5‘h, y(0) + 0.5*L(1), y'(0) + 0.5‘L(1))= 

0.0949 

43 

L(3)= 

h*(y'(0) + 2*L'(2) - L'(1))= 

-0.0709 

44 

L'(3)= 

h‘f(x(0) + h, y(0) + 2*L(2) - L(1), y'O + 2*L'(2) - L'(1))= 

0.0934 

45 




46 

y(3)= 

y(0) + (L(1) + 4*L(2) + L(3))/6 

0.7444 

47 

y'(3)= 

y'(0) + (L'(1) + 4*L'(2) + L'(3))/6= 

-0.7074 
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Integration by Numerical Methods 


Chapter 10 


T his chapter is an introduction to numerical methods for integrating functions which are very 
difficult or impossible to integrate using analytical means. We will discuss the trapezoidal 
rule that computes a function f(x) with a set of linear functions, and Simpson’s rule that 
computes a function f (x) with a set of quadratic functions. 

10.1 The Trapezoidal Rule 

Consider the function y = f(x) for the interval a < x < b, shown in Figure 10.1. 



Figure 10.1. Integration by the trapezoidal rule 

To evaluate the definite integral J f(x)dx, we divide the interval a<x<b into n subintervals 

each of length Ax = - — a . Then, the number of points between x 0 = a and x n = b is 
Xj = a + Ax, x 2 = a + 2Ax, ..., x n _j = a + (n- l)Ax. Therefore, the integral from a to b is the sum 
of the integrals from a to Xj , from x, to x 2 , and so on, and finally from x n _ j to b . The total area 
is 

| f(x)dx = | f(x)dx + J f(x)dx + ... + J f(x)dx = zf f(x)dx 
1 k = 1 k ~’ 

The integral over the first subinterval, can now be approximated by the area of the trapezoid 
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Chapter 10 Integration by Numerical Methods 

aPgPjXj that is equal to |(y 0 + yi)Ax plus the area of the trapezoid XjPjP 2 X 2 that is equal to 
^(y i + y 2 )Ax, and so on. Then, the trapezoidal approximation becomes 

T = |(yo + yi)Ax + |( yi +y 2 )Ax+ ... + ^(y n _ j + y n )Ax 
or 

T = (iy„ + y 1 + y 2 + .. + y„-, + iy n )ix (10 .i) 

Trapezoidal Rule 


Example 10.1 

Using the trapezoidal rule with n = 4, estimate the value of the definite integral 

[ x * 2 dx 

J i 

Compare with the exact value, and compute the percent error. 

Solution: 

The exact value of this integral is 

2 31 2 

f x 2 dx = - =§-1 = 2 = 2.33333 
Jj 3 |j 3 3 3 


For the trapezoidal rule approximation we have 


Then, 



2-1 

4 


y = f(x) = x 2 


1 

4 


( 10 . 2 ) 


(10.3) 


10-2 
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The Trapezoidal Rule 


1 r/ \ 1 2 16 

x o = a = 1 yo = f ( x o) = 1 = 16 

x, = a + Ax = | y, = f(x,) = (|) 2 = f 6 

x 2 = a + 2Ax = | y 2 f(x 2 ) = (|) 2 = || 

x 3 = a + 3Ax = 1 y, f(x 3 ) = (|) = 

x - = b = 2 y 4 = f(* 4 > - (I)' - % 

and by substitution into (10.1), 


T _ ri l6 25 36 49 l 64') l _ 150 1 

v 2 16 16 16 16 2 16 / 4 16 4 

From (10.3) and (10.4), we find that the percent error is 


— = 2.34375 


% Error = 


2,34375 -2,33333 
2.33333 


100 = 0.45 % 


(10.4) 


(10.5) 


The MATLAB function trapz(x,y,n) where y is the integral with respect to x, approximates the 
integral of a function y = f(x) using the trapezoidal rule, and n (optional) performs integration 
along dimension n. 


Example 10.2 

Use the MATLAB function trapz(x,y) to approximate the value of the integral 

f -dx (10.6) 

J i x 

and by comparison with the exact value, compute the percent error when n = 5 and n = 10 

Solution: 

The exact value is found from 

(A i 2 

1 -dx = lnxl, = ln2 - lnl = 0.6931 -0.0000 = 0.6931 
Jj x 11 

For the approximation using the trapezoidal rule, we let x 5 represent the row vector with n = 5 , 
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and x 10 the vector with n = 10, that is, Ax = 1/5 and Ax = 1/10 respectively. The corre¬ 
sponding values of y are denoted as y 5 and y 10 , and the areas under the curve as area5 and 
area 10 respectively. We use the following MATLAB script. 

x5=linspace(1,2,5); xl0=linspace(1,2,10); 
y5=17x5; yl0=17x10; 
area5=trapz(x5,y5), areal 0=trapz(x10,y10) 

area5 = 

0.6970 

arealO = 

0.6939 


The percent error when Ax =1/5 is used is 


% Error 


0.6970-0.6931 

0.6931 


100 = 0.56 % 


and the percent error when Ax = 1/10 is used is 


% Error = 


0.6939-0.6931 

0.6931 


100 = 0.12 % 


Example 10.3 
The integral 

f(t) = [V^dx (10.7) 

J o 

where t is a dummy variable of integration, is called the error function and it is used extensively 
in communications theory. Use the MATLAB trapz(x,y) function to find the area under this 
integral with n = 10 when the upper limit of integration is t = 2. 

Solution: 

We use the same procedure as in the previous example. The MATLAB script for this example is 
t=linspace(0,2,10); y=exp(-t. A 2); area=trapz(t,y) 

MATLAB displays the following result. 


* The formal definition of the error function is erf(u) 


if 
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The Trapezoidal Rule 


area 


0.8818 


Example 10.4 

The i - v (current-voltage) relation of a non-linear electrical device is given by 


i(t) = 0.1(e°' 2v(t) - 1) 


( 10 . 8 ) 


where v(t) = sin3t. 

By any means, find 

a. The instantaneous power p(t) 

b. The energy W(t 0 , t,) dissipated in this device from t 0 = 0 to t, = 10 

Solution: 

a. The instantaneous power is 


p(t) = v(t)i(t) = 0.1 sin3t(e°' 2sm3t - 1) 
b. The energy is the integral of the instantaneous power, that is, 


(10.9) 



( 10 . 10 ) 


An analytical solution of the last integral is possible using integration by parts, but it is not 
easy. We can try the MATLAB int(f,a,b) function where f is a symbolic expression, and a and 
b are the lower and upper limits of integration respectively. 

When MATLAB cannot find a solution, it returns a warning. For this example, MATLAB 
returns the following message when integration is attempted with the symbolic expression of 
( 10 . 10 ). 

t=sym('t'); 

s=int(0.1 *sin(3*t)*(exp(0.2*sin(3*t))-1 ),0,10) 

When this script is executed, MATLAB displays the following message. 

Warning: Explicit integral could not be found. 

Next, we will find and sketch the power and energy by the trapezoidal rule using the MAT¬ 
LAB trapz(x,y) function. For this example, we choose n = 100, so that Ax = 1/100. The 
MATLAB script below will compute and plot the power. 

t=linspace(0,10,100); 

v=sin(3.*t); i=0.1.*(exp(0.2.*v)-1); p=v.*i; 
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plot(t,p); grid; title('Power vs Time 1 ); xlabel('seconds'); ylabelCwatts 1 ) 

The power varies in a uniform fashion as shown by the plot of Figure 10.2. 



Figure 10.2. Plot for the power variation in Example 10.4 

The plot of Figure 10.2 shows that the power is uniform for all time, and thus we expect the 
energy to be constant. 

The MATLAB script below computes and plots the energy. 

energy=trapz(t,p), plot(t,energy,'+'); grid; title('Energy vs Time 1 );... 
xlabel('seconds'); ylabel('joules') 

energy = 

0.1013 

Thus, the value of the energy is 0.1013 joule. The energy is shown in Figure 10.3. 


10.2 Simpson’s Rule 

The trapezoidal and Simpson’s rules are special cases of the Newton-Cote rules which use higher 
degree functions for numerical integration. 

Let the curve of Figure 10.4 be represented by the parabola 

y = ax 2 + p X + y (10.11) 
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Simpson’s Rule 





Figure 10.3. Plot for the energy of Example 10.4 



Figure 10.4. Simpson’s rule of integration 
The area under this curve for the interval -h < x < h is 

h 3 R 2 | h 

Area|_ h = j (ax 2 + Px + y)dx = + l-E- + yx 

= £*! + 6t! +Th _C_£s5! + 6t!_ rh )=2st! + 2r h (1(U2> 

3 2 V 3 2 2 3 

= |h(2ah 3 + 6y) 

The curve passes through the three points (-h, y 0 ), (0, yj), and (h, y 2 ). Then, by (10.11) we 
have: 
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Chapter 10 Integration by Numerical Methods 


Yo = ah 2 -ph + y (a) 

Yi = Y (b) 

y 2 = ah 2 + (3h + y (c) 

(10.13) 

We can now evaluate the coefficients a, p, y and express (10.12) in terms of h, y 0 , 
This is done with the following procedure. 

By substitution of (b) of (10.13) into (a) and (c) and rearranging we obtain 

yj and y 2 . 

ah 2 - ph = y 0 - yi 

(10.14) 

ah + ph = y 2 -yj 

(10.15) 

Addition of (10.14) with (10.15) yields 


2ah 2 = y 0 - 2y, + y 2 

(10.16) 

and by substitution into (10.12) we obtain 


Area l-h = |b(2ah 3 + 6y) = |h[(y 0 - 2 Yl + y 2 ) + 6 yi ] 

(10.17) 

or 


Area l-h = ^ h (Yo + 4 Yi + Y2) 

(10.18) 


Now, we can apply (10.18) to successive segments of any curve y = f(x) in the interval a < x < b 
as shown on the curve of Figure 10.5. 



Figure 10.5. Simpson’s rule of integration by successive segments 


From Figure 10.5, we observe that each segment of width 2h of the curve can be approximated by 
a parabola through its ends and its midpoint. Thus, the area under segment AB is 
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Area l AB = 3 h (y 0 + 4 yi + y 2 ) 


(10.19) 


Likewise, the area under segment BC is 


Area l BC = 3 h (y 2 + 4y 3 + y4) 


( 10 . 20 ) 


and so on. When the areas under each segment are added, we obtain 


Area = -h(y 0 + 4 yi + 2y 2 + 4y 3 + 2y 4 + ... + 2y n _ 2 + 4y n _ j + y n ) 


( 10 . 21 ) 


Simpson's Rule of Numerical Integration 


Since each segment has width 2h, to apply Simpson’s rule of numerical integration, the number n of 
subdivisions must be even. This restriction does not apply to the trapezoidal rule of numerical inte¬ 
gration. The value of h for (10.21) is found from 


u b ~ a 

h = - n = even 


( 10 . 22 ) 


n 


Example 10.5 

Using Simpson’s rule with 4 subdivisions (n = 4), compute the approximate value of 



(10.23) 


Solution: 


This is the same integral as that of Example 10.2 where we found that the analytical value of this 
definite integral is ln= 0.6931. We can also find the analytical value with MATLAB’s int(f,a,b) 
function where f is a symbolic expression, and a and b are the lower and upper limits of integra¬ 
tion respectively. For this example, 

syms x 

Area=int(1/x,1,2) 

Area = 
log(2) 

We recall that log(x) in MATLAB is the natural logarithm. 

To use Simpson’s rule, for convenience, we construct the following table using the spreadsheet of 
Figure 10.6. 
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A | B 

c 

II D 

E 

1 

Example 10.5 




2 

f(1/x)dx evaluated from a = 1 to b = 2 with n = 4 


3 

Numerical integration by Simpson's method follows 


4 

Given 

a= 

1 



5 


b= 

2 



6 


n= 

4 



7 

Then, 

h = (b-a)/n = 

0.2500 



8 




Multiplier 

Products 

9 


x 0 =a= 

1.00000 



10 


y 0 =1/x 0 = 

1.00000 

1 

1.00000 

11 


x,=a+h= 

1.25000 



12 


yi=1/xi= 

0.80000 

4 

3.20000 

13 


x 2 =a+2h= 

1.50000 



14 


y 2 =1/x 2 = 

0.66667 

2 

1.33333 

15 


x 3 =a+3h= 

1.75000 



16 


y3=i/x 3 = 

0.57143 

4 

2.28571 

17 


x 4 =b= 

2.00000 



18 


y 4 =1/x4= 

0.50000 

1 

0.50000 

19 



Sum of Products = 

8.31905 

20 

Area = (h/3)*(Sum of Products) = (1/12)*8.31905 = 

0.69325 


Figure 10.6. Spreadsheet for numerical integration of (10.23) 


By comparison of the numerical with the exact value, we observe that the error is very small when 
Simpson’s method is applied. 


MATLAB has two quadrature functions for performing numerical integration, the quad and 
quad8. The description of these can be seen by typing help quad or help quad8. Both of these 
functions use adaptive quadrature methods; this means that these methods can handle irregularities 
such as singularities. When such irregularities occur, MATLAB displays a warning message but 
still provides an answer. 

The quad function uses an adaptive form of Simpson’s rule, while the quad8 function uses the 
so-called Newton-Cotes 8-panel rule. The quad8 function detects and handles irregularities more 
efficiently. 

Both functions have the same syntax, that is, q=quad(‘f’,a,b,tol), and integrate to a relative error 
tol which we must specify. If tol is omitted, it is understood to be the standard tolerance of 10 3 . 
The string ‘f’ is the name of a user defined function, and a and b are the lower and upper limits of 
integration respectively. 
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Simpson’s Rule 

Example 10.6 

Given the definite integral 

y= f(x) = [ e -x dx (10.24) 

J o 

a. Use MATLAB’s symbolic int function to obtain the value of this integral 

b. Obtain the value of this integral with the q=quad(‘f’,a,b) function 

c. Obtain the value of this integral with the q=quad(‘f’,a,b,tol) function where tol = 10 10 

d. Obtain the value of this integral with the q=quad8(‘f’,a,b) function 

e. Obtain the value of this integral with the q=quad8(‘f’,a,b,tol) function where tol = 10” 10 

Solution: 

a. 

syms x; y=int(exp(-x A 2),0,2) % Define symbolic variable x and integrate 

Y = 

l/2*erf(2)*pi A (1/2) 

pretty(y) 

1/2 

1/2 erf(2) pi 

erf is an acronym for the error function and we can obtain its definition with help erf 

b. First, we need to create and save a function m-file. We name it errorfcnl .m as shown below. 
We will use format long to display the values with 15 digits. 

function y = errorfcnl (x) 
y = exp(-x A 2); 

With this file saved as errorfcnl .m, we write and execute the following MATLAB script. 

format long 

y_std=quad('errorfcn1 ',0,2) 

We obtain the answer in standard tolerance form as 
y_std = 

0.88211275610253 

c. With the specified tolerance, the script and the answer are as follows: 

y_tol=quad('errorfcn1 ',0,2,10 A -10) 

y_tol = 

0.88208139076242 
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d. With the standard tolerance, 

y_std8=quad8('errorfcn1 ',0,2) 

y_std8 = 

0.88208139076194 

e. With the specified tolerance, 

y_tol8=quad8('errorfcn1 ',0,2,10 A -10) 

y_tol8 = 

0.88208139076242 

We observe that with the 10 10 tolerance, both quad and quad8 produce the same result. 


Example 10.7 

Using the quad and quad8 functions with standard tolerance, evaluate the integral 


y = f(x) = | Jxdx 


(10.25) 


at ((a, b) = (0.2, 0.8), (1.4, 2.3)), and (3,8) . Use the fprintf function to display first the analytical 
values, then, the numerical values produced by the quad and quad8 functions for each set of 
data. 

Solution: 

Evaluating the given integral, we obtain 



(10.26) 


where a and b are non-negative values. Substitution of the values of the given values of a and b 
will be included in the MATLAB script below. 

The sqrt function in a built-in function and therefore, we need not write a user defined m-file. 
We will include the input function in the script. The script is then saved as Example_10_7. 

% This script displays the approximations obtained with the quad and quad8 functions 
% with the analytical results for the integration of the square root of x over the 
% interval (a,b) where a and b are non-negative. 

% 

fprintff \n'); % Insert line 

a=input('Enter first point "a" (non-negative):'); 

b=input('Enter second point "b" (non-negative):'); 
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k=2/3.*(b. A (1.5)-a. A (1.5)); 
kq=quad('sqrt',a,b); 
kq8=quad8('sqrt',a,b); 
fprintff \n');... % Insert line 

fprintff Analytical: %f \n Numerical quad, quad8: %f %f \n',k,kq,kq8) 
fprintff \n'); fprintf(' \n') % Insert two lines 

Now, we execute this saved file by typing its name, that is, 

Example_10_7 


Enter first point "a" 
Enter second point "b" 

Analytical: 0.417399 
Numerical quad, quad8: 

Example_10_7 

Enter first point "a" 
Enter second point "b" 

Analytical: 1.221080 
Numerical quad, quad8: 

Example_10_7 

Enter first point "a" 
Enter second point "b" 

Analytical: 11.620843 
Numerical quad, quad8: 


(non-negative) : 0.2 
(non-negative) : 0.8 

0.417396 0.417399 

(non-negative) : 1.4 
(non-negative) : 2.3 

1.221080 1.221080 

(non-negative): 3 
(non-negative): 8 

11.620825 11.620843 
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10.3 Summary 

• We can evaluate a definite integral J f(x)dx with the trapezoidal approximation 
t = (|y 0 + yi + y2 + -- + yn-i + ^yn) Ax 


by dividing interval a < x < b into n subintervals each of length Ax = -—- . The number n of 
subdivisions can be even or odd. 

• The MATLAB function trapz(x,y,n) where y is the integral with respect to x, approximates 
the integral of a function y = f (x) using the trapezoidal rule, and n (optional) performs inte¬ 
gration along dimension n. 

• We can perform numerical integration with the MATLAB function int(f,a,b) function where f 
is a symbolic expression, and a and b are the lower and upper limits of integration respectively. 

• We can evaluate a definite integral J f(x)dx with Simpson’s rule of numerical integration 
using the expression 

Area = ^h(y 0 + Ay x + 2y 2 + 4y 3 + 2y 4 + ... + 2y n _ 2 + 4y n _ 1 + y n ) 

where the number n of subdivisions must be even. 

• The trapezoidal and Simpson’s rules are special cases of the Newton-Cote rules which use 
higher degree functions for numerical integration. 

• MATLAB has two quadrature functions for performing numerical integration, the quad and 
quad8. Both of these functions use adaptive quadrature methods. The quad function uses an 
adaptive form of Simpson’s rule, while the quad8 function uses the so-called Newton-Cotes 8- 
panel rule. The quad8 function detects and handles irregularities more efficiently. Both func¬ 
tions have the same syntax, that is, q=quad(‘f’,a,b,tol), and integrate to a relative error tol 
which we must specify. If tol is omitted, it is understood to be the standard tolerance of 10” 3 . 
The string T is the name of a user defined function, and a and b are the lower and upper limits 
of integration respectively. 
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10.4 Exercises 

1. Use the trapezoidal approximation to compute the values the following definite integrals and 
compare your results with the analytical values. Verify your answers with the MATLAB 

trapz(x,y,n) function. 

a. f xdx n = 4 

J o 

b. f x 3 dx n = 4 

J o 

f 2 4 

c. x dx n = 4 

J o 

d. I" ~dx n = 4 

J i x 

2. Use Simpson’s rule to approximate the following definite integrals and compare your results 
with the analytical values. Verify your answers with the MATLAB quad(‘f’,a,b) function. 

a. f x 2 dx n = 4 

J o 

b. [ sinxdx n = 4 

J o 

c. j" 1 -~ dx n = 4 
J o x + 1 
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10.5 Solution to End-of-Chapter Exercises 

1 . 


t = f^y 0 + yi + Y2 + + y n -i + ^yn) Ax 


l. The exact value is 


| xdx = - 


For the trapezoidal rule approximation we have 

x 0 = a = 0 
x n = b = 2 
n = 4 

Ax = = 2-0 = 1 


y = f(x) = x 


y 0 = f ( x o) = 0 


a + 2Ax =1 y 2 = f(x 2 ) = 1 


■-a 


y 4 = f (x 4 ) = 2 


2 ..° + I + 1 + | + ix 2 ) 


<i = 4xl = 2 
2 2 


x=linspace(0,2,4); y=x; area=trapz(x,y) 

area = 

2 

b. The exact value is 

2 4| 2 

f x 3 dx = — =4 

J o 4 | 0 

For the trapezoidal rule approximation we have 
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x 0 = a = 0 
x n = b = 2 
n = 4 

Ax = = 2^0 


y = f(x) = x J 


1 

2 


x 0 = a = 0 

x, = a + Ax = - 
1 2 

x 2 = a + 2Ax = 1 

x, = a + 3 Ax = - 
3 2 

x 4 = b = 2 


y 0 = f ( x o) = 0 

Yi = f ( x i) = l 

y 2 = f ( x 2) = 1 

y 3 = f( x 3) = f 

y 4 = f ( x 4 ) = 8 


4 x8 ) x H 5+ l) x H 25 


x=linspace(0,2,4); y=x. A 3; area=trapz(x,y) 

area = 

4.4444 

The deviations from the exact value are due to the small number of divisions n we chose. 


c. The exact value is 

fVdx = 4 = 32 = 64 
J o 5 |„ 5 

For the trapezoidal rule approximation we have 
x 0 = a = 0 
x n = b = 2 
n = 4 

Ax = = 2^0 = 1 


y = f( X ) = X 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


10-17 





Chapter 10 Integration by Numerical Methods 

x o 

= a = 0 

y 0 = 

f( x o) = 

0 

x i 

= a + Ax = - 
2 

Yi = 

f( x i) = 

1 

16 

X 2 

= a + 2Ax = 1 

y 2 = 

f(x 2 ) = 

1 

x 3 

= a + 3Ax = - 
2 

y 3 = 

f( X3 ) = 

81 

8 

x 4 

= b = 2 

y 4 = 

f(x 4 ) = 

16 


T = f^xO + — +1+ — + ^xl6 N )x^ = f9 + —= 7.0625 
v 2 16 16 2 ) 2 V 8 7 2 

x=linspace(0,2,4); y=x. A 4; area=trapz(x,y) 

area = 

7.5720 


d. The exact value is 


rTdx = -if = 

J , y 2 x L 


For the trapezoidal rule approximation we have 
x 0 = a = 1 
x n = b = 2 
n = 4 

. b-a _ 2-1 


Ax = ! 


1 

2 


1 

4 


y = f( X ) = 1/X 2 


x o 

= a 

= 1 


y 0 = 

f( x o) = 

1 

x i 

= a 

+ Ax = 

. 5 

4 

yi = 

f( x i) = 

16 

25 

x 2 

= a 

+ 2Ax 

_ 3 

2 

y 2 = 

f( x 2 ) = 

4 

9 

x 3 

= a 

+ 3Ax 

_ 7 

4 

y 3 = 

f( x 3 ) = 

16 

49 

x 4 

= b 

= 2 


y 4 = 

f(x 4 ) = 

1 

4 

1 + 

16 4 

4 16 

1 

. 

_ f3905' 

)x- 


25 

'9 49 

+ 2 X ; 

4 ' 

V1918- 

/ t 


10-18 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 






Solution to End-of-Chapter Exercises 


x=linspace(1,2,4); y=1./x. A 2; area=trapz(x,y) 

area = 

0.5158 


2 . 


• + 2 y n -2 + 4 yn-i + yn) 


a. The exact value is 

fx 2 dx = —I = - = 2.6667 

o 3 lo 3 

To use Simpson’s rule we construct the following table using a spreadsheet. 



A | B 

c 

D 


1 

Exercise 10.2.a 




2 

fx 2 dx evaluated from a = 0 to b = 2 with n = 4 


3 

Numerical integration by Simpson’s method follows 

4 

Given 

a= 

0 



5 


b= 

2 



6 


n= 

4 



7 

Then, 

h = (b-a)/n = 

0.5000 



8 




Multiplier 

Products 

9 


Xo=a= 

0.00000 



10 


Yo =x o 2= 

0.00000 

1 

0.0000 

11 


X!=a+h= 

0.50000 



12 


yi=Xi 2 = 

0.25000 

4 

1.0000 

13 


x 2 =a+2h= 

1.00000 



14 


y 2 =x 2 2 = 

1.00000 

2 

2.0000 

15 


x 3 =a+3h= 

1.50000 



16 


y3= x 3 2 = 

2.25000 

4 

9.0000 

17 


X4=b= 

2.00000 



18 


y 4 =X4 2 = 

4.00000 

1 

4.0000 

19 



Sum of Products = 

16.0000 

20 

Area = (h/3)*(Sum of Products) = (1/12)*8.31905 = 

2.6667 


We create and save a function m-file. We name it exer_10_2_a.m as shown below. 

function y = exer_10_2_a(x) 
y = x. A 2; 

We write and execute the following MATLAB script: 

y_std=quad('exer_10_2_a',0,2) 

y_std = 

2.6667 
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b. The exact value is 


f sinxdx = -cosx| 0 = -(- 1-1) = 2 
•'n ’ 


To use Simpson’s rule we construct the following table using a spreadsheet. 



A | B 

c 

D 

E 

1 

Exercise 10.2.b 




2 

/ sinxdx evaluated from a = Oto b = n with n = 4 


3 

Numerical integration by Simpson's method follows 

4 

Given 

a= 

0 



5 


b= 

3.14159 



6 


n= 

4 



7 

Then, 

h = (b-a)/n = 

0.7854 



8 




Multiplier 

Products 

9 


Xo=a= 

0.00000 



10 


y 0 =sinx 0 = 

0.00000 

1 

0.0000 

11 


x 1 =a+h= 

0.78540 



12 


y 1 =sinx 1 = 

0.70711 

4 

2.8284 

13 


x 2 =a+2h= 

1.57080 



14 


y 2 =sinx 2 = 

1.00000 

2 

2.0000 

15 


x 3 =a+3h= 

2.35619 



16 


y 3 =sinx 3 = 

0.70711 

4 

2.8284 

17 


X4=b= 

3.14159 



18 


y 4 =sinx 4 = 

0.00000 

1 

0.0000 

19 



Sum of Products = 

7.6569 

20 

Area = (h/3)*(Sum of Products) = (1/12)*8.31905 = 

2.0046 


We create and save a function m-file. We name it exer_10_2_b.m as shown below. 

function y = exer_10_2_b(x) 
y = sin(x); 

We write and execute the following MATLAB script: 

y_std=quad('exer_10_2_b',0,pi) 

y_std - 

2.0000 

c. The exact value is 

f — r~ — dx = tan -1 xL = - = 0.7854 
J o x 2 + 1 10 4 

To use Simpson’s rule we construct the following table using a spreadsheet. 
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Solution to End-of-Chapter Exercises 



A | B 

C 

D 

II E 

1 

Exercise 10.2.c 




2 

f(1/(x 2 +1))dx evaluated from a = 0to b = 1 with n = 4 

3 

Numerical integration by Simpson's method follows 


4 

Given 

a= 

0 



5 


b= 

1 



6 


n= 

4 



7 

Then, 

h = (b-a)/n = 

0.2500 



8 




Multiplier 

Products 

9 


x 0 =a= 

0.00000 



10 


y 0 =1/(xo 2 +1)= 

1.00000 

1 

1.0000 

11 


x 1 =a+h= 

0.25000 



12 


y n =1/( Xl 2 +1)= 

0.94118 

4 

3.7647 

13 


x 2 =a+2h= 

0.50000 



14 


y 2 =1/(x 2 2 + 1)= 

0.80000 

2 

1.6000 

15 


x 3 =a+3h= 

0.75000 



16 


y 3 =1/(x 3 2 +1)= 

0.64000 

4 

2.5600 

17 


x 4 =b= 

1.00000 



18 


y 4 =1/(x4 2 +1)= 

0.50000 

1 

0.5000 

19 



Sum of Products = 

9.4247 

20 

Area = (h/3)*(Sum of Products) = (1/12)*8.31905 = 

0.7854 


We create and save a function m-file. We name it exer_10_2_c.m as shown below. 

function y = exer_10_2_c(x) 
y = 1 ./(x. A 2+1); 

We write and execute the following MATLAB script: 

y_std=quad('exer_10_2_c',0,1) 

y_std = 

0.7854 
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Chapter 11 


Difference Equations 


T his chapter is an introduction to difference equations based on finite differences. The dis¬ 
cussion is limited to linear difference equations with constant coefficients. The Fibonacci 
numbers are defined, and a practical example in electric circuit theory is given at the end 
of this chapter. 


11.1 Introduction 

In mathematics, a recurrence relation is an equation which defines a sequence recursively: each 
term of the sequence is defined as a function of the preceding terms. A difference equation is a 
specific type of recurrence relation, and this type is discussed in this chapter. Difference equa¬ 
tions as used with discrete type systems, are discussed in Appendix A. 

11.2 Definition, Solutions, and Applications 

The difference equations discussed in this chapter, are used in numerous applications such as 
engineering, mathematics, physics, and other sciences. 

The general form of a linear, constant coefficient difference equation has the form 

(a r E r + a r _ jE r ~ 1 + ... + ajE + a 0 )y = 4>(x) (11.1) 

where a k represents a constant coefficient and E is an operator similar to the D operator in 
ordinary differential equations. The E operator increases the argument of a function by one 
interval h, and r is a positive integer that denotes the order of the difference equation. 

In terms of the interval h, the difference operator E is 

Ef(x k ) = f(x k + h) = f(x k + h ) (11.2) 

The interval h is usually unity, i.e., h = 1, and the subscript k is normally omitted. Thus, 
(11.2) is written as 

Ef(x) = f(x+l) = f x + 1 (11.3) 

If, in (11.3), we increase the argument of f by another unit, we obtain the second order operator 
E 2 , that is, 
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Chapter 11 Difference Equations 


and in general, 


E 2 f(x) = E[Ef(x)] = Ef (x + 1) = f (x + 2) = f x + 2 
E r f(x) = f(x + r) = f x + r 


(11.4) 

(11.5) 


As with ordinary differential equations, the right side of (11.3) is a linear combination of terms 
such as kx, coskx, and x n , where k is a non-zero constant and n is a non-negative integer. 
Moreover, if, in (11.1), (p (x) = 0, the equation is referred to as a homogeneous difference equation, 
and if <p(x) * 0, it is a non-homogeneous difference equation. 

If, in (11.1), we let r = 2, we obtain the second order difference equation 

(a 2 E 2 + a x E + a 0 )y = <))(x) (11.6) 

and if the right side is zero, it reduces to 

(a 2 E 2 + a x E + a 0 )y = 0 (11.7) 


If y,(x) and y 2 (x) are any two solutions of (11.7), the linear combination k x y x (x) + k 2 y 1 (x) is 
also a solution. Also, if the C asorati determinant, analogous to the Wronskian determinant in ordi¬ 
nary differential equations, is non-zero, that is, if 


C[yi(x), y 2 (x)] 


y i ( x ) y 2 ( x ) 

Eyi(x) Ey 2 (x) 


then, any other solution of (11.7) can be expressed as 

y 3 (x) = k iyi (x) + k 2 y 2 (x) 


where k x and k 2 are constants. 

For the non-homogeneous difference equation 

(a 2 E 2 + a x E + a 0 )y = (|>(x) 


( 11 . 8 ) 


(11.9) 


( 11 . 10 ) 


where (p(x) + 0, if Y(x) is any solution of (11.10), then the complete solution is 

y = kiYi(x) + k 2 y 2 (x) + Y(x) (n.ii) 

As with ordinary differential equations, we first find the solution of the homogeneous difference 
equation; then, we add the particular solution Y(x) to it to obtain the total solution. We find 
Y(x) by the Method of Undetermined Coefficients. 
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Definition, Solutions, and Applications 

We have assumed that the coefficients a, in (11.10) are constants; then, in analogy with the 

solution of the differential equation of the form y = ke ax , for the homogeneous difference equa¬ 
tion we assume a solution of the form 

y = M x (11.12) 

By substitution into (11.7), and recalling that Ef(x) = f(x + 1), we obtain 

a 2 M x + 2 + a t M x+1 + a 0 M x = 0 (11.13) 

and this is the characteristic equation of a second order difference equation. 

As with algebraic quadratic equations, the roots of (11.13) can be real and unequal, real and 
equal, or complex conjugates depending on whether the discriminant a 2 - 4a 2 a 0 is positive, zero, 
or negative. These cases are summarized in Table 11.1. 


TABLE 11.1 Roots of the characteristic equation in difference equations 


Characteristic equation a 2 M“ + a 1 M + a 0 = 0 of (a 

. 2 E 2 + a 1 E + a 0 )y = 0 

Roots Mj and M 2 

Discriminant 

General Solution 

Real and Unequal 

Mj *M 2 

aj-4a 2 a 0 >0 

y = kjMj X + k 2 M 2 X 
kj and k 2 constants 

Real and Equal 

Mj = Mj 

a i _ 4a 2 a 0 = 0 

y = kjMj +k 2 xM 2 
kj and k 2 constants 

Complex Conjugates 

Mj = a+jp 

M 2 = a-jp 

a i “ 4a 2 a 0 < 0 

y = r X (CjCOs0x + C 2 sin0x) 

r = Ja 2 + P 2 0 = tan 

a 


Example 11.1 

Find the solution of the difference equation 

(E 2 -6E + 8)y = 0 (11T4) 

with initial conditions y 0 = y(0) = 3 and yj = y(l) = 2. Then, compute y 5 = y(5). 

Solution: 

The characteristic equation of (11.14) is 
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Chapter 11 Difference Equations 

M 2 -6M + 8 = 0 (11.15) 

and its roots are Mj = 2 and M 2 = 4. Therefore, with reference to Table 11.1, we obtain the 
solution 

y x = y(x) = k 1 2 x + k 2 4 x (11.16) 

To make use of the first initial condition, we let x = 0. Then, (11.16) becomes 

y 0 = 3 = k 1 2° + k 2 4° 
or 

kj+k 2 = 3 (11.17) 

For the second initial condition, we let x = 1. Then, (11.16) becomes 

Yi = 2 = k^ 1 +k 2 4 ! 
or 

2k l + 4k 2 = 2 (11.18) 

Simultaneous solution of (11.17) and (11.18) yields k x = 5 and k 2 = -2 . Thus, the solution is 
y x = 5 • 2 x -2 • 4 X (11.19) 

For x = 5, we obtain 

y 5 = 5 • 2 5 - 2 • 4 5 = 5 x 32 - 2 x 1024 = -1888 


Example 11.2 

Find the solution of the difference equation 

(E 2 + 2E + 4)y = 0 (11.20) 

Solution: 

The characteristic equation of (11.20) is 

M 2 + 2M + 4 = 0 (11.21) 

and its roots are = - 1 +jV3 and M 2 = -l-jV3. From Table 11.1, r = J{- 1) 2 + (V3) 2 = 2 

and 0 = tan 1)) = 2ji/ 3 . Therefore, the solution is 
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y = 2 x (c 1 cos^x + C 2 sin^xj (11.22) 

The constants Cj and C 2 can be evaluated from the initial conditions. 


For non-homogeneous difference equations of the form of (11.10), we combine the particular 
solution with the solution of the homogeneous equation shown in (11.11). For the particular 
solution, we start with a linear combination of all the terms of the right side, that is, 4>(x), and 
we apply the operator E. If any of the terms in the initial choice duplicates a term in the solution 
of the homogeneous equation, this choice must be multiplied by x until there is no duplication 
of terms. 

Table 11.2 shows the form of the particular solution for different terms of <j)(x). 


TABLE 11.2 Form of the particular solution for a non—homogeneous difference equation 


Non-homogeneous difference equation (a 2 E 2 + ajE + a 0 )y = (|>(x) 

4» (x) 

Form of Particular Solution Y(x) 

a (constant) 

A (constant) 

ax k (k = positive integer) 

. k . k- 1 . . 

A k x +A kl x +...+A 1 x + A 0 

ak 

Ak x 

acosmx or asinmx 

Aj cosmx + A 2 sinmx 

k x k x 

ax 1 cosmx or ax 1 sinmx 

j ^ 

(A k x +A k l x + ... + AjX + A 0 )l cosmx 

k k 1 x 

+ (B k x +B k _jX + ... + BjX + B 0 )l sinmx 


Example 11.3 

Find the solution of the difference equation 

(E 2 -5E + 6)y = x + 2 x (11.23) 

Solution: 

The characteristic equation of (11.23) is 

M 2 -5M + 6 = 0 (11.24) 
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Chapter 11 Difference Equations 

and its roots are = 2 and M 2 = 3 . From Table 11.1, the solution Y H of the homogeneous 
difference equation is 

Y h = kj2 x + k 2 3 x (11.25) 

For the particular solution we refer Table 11.2. For the first term x of the right side of (11.23), we 
use the term A,x + A 0 , or Ax + B. For the second term 2 X , we obtain A2 X or C2 X ’ and thus, the 
particular solution has the form 

Y p = Ax + B + C2 X (11.26) 

But the term C2 in (11.26), is also a term in (11.25). Therefore, to eliminate the duplication, 
we multiply the term C2 X by x. Thus, the correct form of the particular solution is 

Y P = Ax + B + Cx2 x (11.27) 

To evaluate the constants A, B, and C, we substitute (11.27) into (11.23). Then, 

[A(x + 2) + B + C(x + 2) -2 x + 2 ]-5[A(x + 1) + B + C(x + 1) -2 X+1 ] (11.28) 

+ 6 [Ax + B + Cx2 x ] = x + 2 x 

Using the law of exponents W™ n = W m xW n , simplifying, and equating like terms, we obtain 

2Ax + (-3A + 2B)-2C2 x = x + 2 x (11.29) 

Relation (11.29) will be true if 

2A = 1 -3A + 2B = 0 -2C = 1 

or 

A = 0.5 B = 0.75 C = -0.5 
By substitution into (11.28), we obtain the particular solution 

Y P = 0.5x + 0.75-0.5x2 x (11.30) 

Therefore, the total solution is the sum of (11.25) and (11.30), that is, 

Ytotai = Y H + Y P = k 1 2 x + k 2 3 x + 0.5x + 0.75-0.5x2 x (11.31) 
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Fibonacci Numbers 


11.3 Fibonacci Numbers 

The Fibonacci numbers are solutions of the difference equation 

y x+2 = y x+ i + y x (H-32) 

that is, in a series of numbers, each number after the second, is the sum of the two preceding 
numbers. 


Example 11.4 

Given that y 0 = 0 and y, = 1 , compute the first 12 Fibonacci numbers. 

Solution: 

For x = 0, 1, 2, 3 and so on, we obtain the Fibonacci numbers 

1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144, 233, ... 


We will conclude this chapter with an application to electric circuit analysis. 


Example 11.5 

For the electric network of Figure 11.1, derive an expression for the voltage V x at each point P x 
where x = 0, 1, 2, ..., n, given that the voltage V 0 at point P 0 is known. 



Figure 11.1. Electric network for Example 11.5 


Solution: 

We need to derive a difference equation that relates the unknown voltage V x to the known 
voltage V 0 . We start by drawing part of the circuit as shown in Figure 11.2, and we denote the 
voltages and currents as indicated. 
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Chapter 11 Difference Equations 



Figure 11.2. Part of the circuit of Figure 11.1 


By application of Kirchoff s Current Law (KCL) at node P x + j of Figure 11.2, we obtain 


and after simplification, 


(11.33) 


Of course, the term 2/R cannot be zero. Therefore, we must have 

V x + 2 -2.5V x+1 +V x = 0 (11.34) 

Relation (11.34) is valid for all points except Pj and P n _ 1 as shown in Figure 11.1; therefore, we 
must find the current relations at these two points. 

Also, by application of Kirchoff s current law (KCL) at node P, of Figure 11.1, we obtain 


Vi-V„ . V, . v,-v. 


R 2R 


R 


and after simplification, 


V 2 -2.5V 1 +V 0 = 0 

Likewise, at node P n _ 1 of Figure 11.1, we obtain 

Vn-l-Vn-2 , Vn-l , Vn-l-Vn . 
R 2R R 

Observing that V n = 0 , and simplifying, we obtain 

2.5V n _ j - V n _ 2 = 0 


(11.35) 


(11.36) 


* The voltages at nodes P 0 and P n are V 0 and V n respectively. 
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Relation (11.35) is a difference equation of the form 

(E 2 -2.5E + l)y = 0 

where y = V x . Its characteristic equation is 

M 2 -2.5M +1=0 (11.37) 

The roots of the characteristic equation of (11.37) are Mj = 0.5 and M 2 = 2. Thus, the solu¬ 
tion is 

y = y x = k 1 (0.5) x + k 2 (2) x (11.38) 


The constant coefficients k, and k 2 in (11.38), are found by substitution of this relation into 
(11.35) and (11.36). Thus, from (11.37) and (11.38), we obtain 

k 1 (O.5) 2 + k 2 (2) 2 -2.5(k 1 (O.5) 1 +k 2 (2) 1 ) + V 0 = 0 
or 

0.25k! + 4k 2 - 1.25k! - 5k 2 + V 0 = 0 
or 

k 1+ k 2 = V 0 (11.39) 

Likewise, from (11.38) and (11.36) we obtain 


or 


or 


or 


2.5(k 1 (i) n_1 + k 2 (2) n - 1 )-ki(i) n “ 2 - k 2 (2) n “ 2 = 0 

2.5k, n _ i k, n-2 

-1 + 2.5k 2 (2)- l -~k 2 (2) = 0 

2 n -i 2 n-2 

2(2,5)k t | 2.5k 2 (2) n 4k t k 2 (2) n = 

2 n 2 2 n 4 


— + k 2 (2) n = 0 (11.40) 

2 n 


Simultaneous solution of (11.39) and (11.40) yields 



(11.41) 
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Chapter 11 Difference Equations 


Finally, substitution of (11.41) into (11.38) yields a solution of the difference equation in terms of 
V 0 , that is, 

v * = 2 -^ v »( 5)’ i+ ^ v » (2)X 




(11.42) 


We observe that when x = 0, 


y - V, - V-l Hr*- - v 0 


and when x = n, 


y = v -l7- 2 


= (2 n -2 n )^^ = 0 

2-1 2-1 
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11.4 Summary 

• The general form of a linear, constant coefficient difference equation has the form 

(a r E r + a r jE r 1 + ... + ajE + a 0 )y = (|)(x) 

where a k represents a constant coefficient and E is an operator similar to the D operator in 
ordinary differential equations. As with ordinary differential equations, the right side is a lin¬ 
ear combination of terms such as kx, coskx, and x 11 , where k is a non-zero constant and n is 
a non-negative integer. If (p (x) = 0, the equation is referred to as a homogeneous difference 
equation, and if cp(x) * 0, it is a non-homogeneous difference equation. 

• The difference operator E is 

Ef(x k ) = f(x k + h) = f(x k + h ) 

The interval h is usually unity, i.e., h = 1, and the subscript k is normally omitted. Thus, 
(11.3) is written as 

Ef(x) = f(x+ 1) = f x + 1 

and in general, 

E r f(x) = f(x + r) = f x + r 

• If yj(x) and y 2 (x) are any two solutions of a homogeneous difference equation, the linear 
combination kjyj(x) + k 2 yj(x), where k, and k 2 are constants, is also a solution. 

• If the Casorati determinant, analogous to the Wronskian determinant in ordinary differential 
equations, is non-zero, that is, if 


C[ yi (x),y 2 (x)] = 


y i ( x ) y 2 ( x ) 




Eyi(x) Ey 2 (x) 

then, any other solution of the homogeneous difference equation can be expressed as 


y 3 (x) = k iyi (x) + k 2 y 2 (x) 

• For the non-homogeneous difference equation 

(a 2 E 2 + a 1 E + a 0 )y = <Kx) 

where cp(x) ^ 0, if Y(x) is any solution of (11.11), then the complete solution is 
y = kiy^xl + k^xl + Ylx) 
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Chapter 11 Difference Equations 


As with ordinary differential equations, we first find the solution of the homogeneous differ¬ 
ence equation; then, we add the particular solution Y(x) to it to obtain the total solution. We 
find Y(x) by the Method of Undetermined Coefficients. 

• In analogy with the solution of the differential equation of the form y = ke ax , for the homoge¬ 
neous difference equation, we assume a solution of the form 

y = M x 

• Since Ef(x) = f(x + 1), the characteristic equation of a second order difference equation is 

a 2 M x + 2 + a 1 M x +1 + a 0 M x = 0 

and as with algebraic quadratic equations, the roots can be real and unequal, real and equal, or 
complex conjugates depending on whether the discriminant a 2 - 4a,a 0 is positive, zero, or neg¬ 
ative. These cases are summarized in Table 11.1. 

• For non-homogeneous difference equations we combine the particular solution with the solu¬ 
tion of the homogeneous equation. For the particular solution, we start with a linear combina¬ 
tion of all the terms of the right side, that is, 4>(x), and we apply the operator E. If any of the 
terms in the initial choice duplicates a term in the solution of the homogeneous equation, this 
choice must be multiplied by x until there is no duplication of terms. The form of the particu¬ 
lar solution for different terms of 4>(x) is shown in Table 11.2. 

• The Fibonacci numbers are solutions of the difference equation 

y x+2 = y x+ i + y x 

that is, in a series of numbers, each number after the second, is the sum of the two preceding 
numbers. 
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Exercises 


11.5 Exercises 

Find the total solution of the following difference equations. 

1. (E 2 + 7E+ 12)y = 0 

2. (E 2 + 2E + 2)y = 0 

3. (E 2 -E-6)y = x + 3 x 

4. (E 2 + l)y = sinx 
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11.6 Solutions to End-of-Chapter Exercises 

1 . 

(E 2 + 7E + 12)y = 0 

The characteristic equation is 

M 2 + 7M+ 12 = 0 

and its roots are Mj = -3 and M 2 = -4. Therefore, with reference to Table 11.1, we obtain 
the solution 

y x = y(x) = k 1 (-3) x + k 2 (-4) x (1) 

The constants kj and k 2 can be evaluated from the initial conditions. Since they were not 
given, let us assume that y 0 = y(0) = 1 and y x = y(l) = 2. 

To make use of the first initial condition, we let x = 0. Then, (1) becomes 

y 0 = 1 = M^ + k^) 0 

or 

kj + k 2 = 1 (2) 

For the second initial condition, we let x = 1. Then, (1) becomes 

Vi = 2 = k^-3) 1 +k 2 (-4) 1 

or 

-3kj -4k 2 = 2 (3) 

Simultaneous solution of (2) and (3) yields kj = 6 and k 2 = -5. Thus, the solution is 

y x = y(x) = 6 x (—3) x —5 x (-4) x 


2 . 


(E 2 + 2E + 2)y = 0 

The characteristic equation is 

M 2 + 2M + 2 = 0 

and its roots are Mj = - 1 + j and M 2 = -1-j. From Table 11.1, r = J {--1 ) 2 + (l) 2 = J2 and 
0 = tan ' 1 /(-l) = —71 /4. Therefore, the solution is 

y = a/ 2 (C 1 cos(-7t/4)x + C 2 sin(-7t/4)x) 
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The constants Cj and C 2 can be evaluated from the initial conditions. For this exercise, they 
were not given. 

3. 

(E 2 - E - 6)y = x + 3 x 

The characteristic equation is 

M 2 -M - 6 = 0 

and its roots are M t = -2 and M 2 = 3 

From Table 11.1, the solution Y H of the homogeneous difference equation is 
Y h = kj(-2) x + k 2 3 x (1) 

For the particular solution we refer Table 11.2. For the first term x of the right side of the 
given equation we use the term AjX + A 0 , or Ax + B . For the second term 3 X , we obtain A3 x 
or C3 ’ and thus, the particular solution has the form 
Y P = Ax + B + C3 x 

But the term C3 X is also a term in the given equation. Therefore, to eliminate the duplica¬ 
tion, we multiply the term C3 X by x. Thus, the correct form of the particular solution is 

Y P = Ax + B + Cx3 x (2) 

To evaluate the constants A, B, and C, we substitute the last expression above into the given 
equation. Then, 

[A(x + 2) + B + C(x + 2) • 3 X + 2 ]-[A(x + 1) + B + C(x + 1) • 3 X+1 ] 

-6[Ax + B + Cx3 x ] = x + 3 x 

Using the law of exponents W m + n = W m xW n , simplifying, and equating like terms, we 
obtain 

-6Ax + (A-6B)+ 15C3 X = x + 3 x 

This relation will be true if 

-6A = 1 A-6B = 0 15C = 1 

A = -1/6 B = 1/36 C = 1/15 
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By substitution into (2), we obtain the particular solution 

Y p = (-l/6)x + 1/36 + (1/I5)x2 x (3) 

Therefore, the total solution is the sum of (1) and (3), that is, 

y to tai = y h + y p = k 1 (-2) x + k 2 3 x + (-l/6)x+l/36 + (l/15)x2 x 


(E 2 + l)y = sinx (1) 


The characteristic equation is 


M + 1 = 0 


and its roots are Mj = j and M 2 = -j 


From Table 11.1, r = J( l) 2 = 1 and 0 = tan ' 1 /0 = 7t/2 . Therefore, the homogeneous part 
of the solution is 

Y h = C 1 cos(7t/2)x + C 2 sin(7t/2)x (2) 

For the particular solution we refer Table 11.2 where we find that the solution has the form 
Ajcosmx + A 2 sinmx, and for this exercise 


Y p = Acosx + Bsinx 

Since the cosine and sine terms appear in the complimentary solution, we multiply the terms of 
the particular solution by x and we obtain 

Y p = Axcosx + Bxsinx (3) 


To evaluate the constants A, B, and C, we substitute the last expression above into (1) and 
we obtain 

A(x + 2)cos(x + 2) + B(x + 2)sin(x + 2) + Axcosx + Bxsinx = sinx 
Using the trig identities 

cos(a + b) = cosacosb - sinasinb 


sin(a + b) = sinacosb - sinbcosa 


expanding, rearranging, equating like terms, and combining the complimentary and particular 
solutions we obtain 


y = C^cos^x + C 2 sin^x + sinx + sin ( x ~ 2 ) 
y 1 2 2 2 2(1+ cos2) 
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Chapter 12 


Partial Fraction Expansion 


T his chapter is an introduction to partial fraction expansion methods. In elementary algebra 
we learned how to combine fractions over a common denominator. Partial fraction expan¬ 
sion is the reverse process and splits a rational expression into a sum of fractions having 
simpler denominators. 


12.1 Partial Fraction Expansion 

The partial fraction expansion method is used extensively in integration and in finding the 
inverses of the Laplace, Fourier, and % transforms. This method allows us to decompose a ratio¬ 
nal polynomial into smaller rational polynomials with simpler denominators, from which we can 
easily recognize their integrals or inverse transformations. In the subsequent discussion we will 
discuss the partial fraction expansion method and we will illustrate with several examples. We 
will also use the MATLAB residue(r,p,k) function which returns the residues (coefficients) r of a 
partial fraction expansion, the poles p and the direct terms k. There are no direct terms if the 
highest power of the numerator is less than that of the denominator. 

Let 

F ( S ) = ( 12 . 1 ) 

where N(s) and D(s) are polynomials and thus (12.1) can be expressed as 


F(s) = 


N(s) 

D(s) 


V m + b m -is m-1 +b m _ 2 s m ^ 2 + ...-tb^ + b, 

n n - 1 n - 2 

a n s +a n _ 1 s +a n _ 2 s + ...+a 1 s + a 0 


( 12 . 2 ) 


The coefficients a k and b k for k = 0, 1,2, ..., n are real numbers and, for the present discus¬ 
sion, we have assumed that the highest power of N(s) is less than the highest power of D(s), i.e., 
m < n. In this case, F(s) is a proper rational function. If m > n , F(s) is an improper rational function. 


It is very convenient to make the coefficient a n of s n in (12.2) unity; to do this, we rewrite it as 

—(b m s m + b m _ 1 s m_1 + b m _ 2 s m ~ 2 + ... +bjS + b 0 ) 

F( s ) = ^ = ^- (12.3) 

D( s ) n a n-1 n — 1 a n -2 n-2 a l a Q 
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The roots of the numerator are called the zeros of F(s), and are found by letting N(s) = 0 in 
(12.3). The roots of the denominator are called the poles of F(s) and are found by letting 
D(s) = 0. 

The zeros and poles of (12.3) can be real and distinct, or repeated, or complex conjugates, or 
combinations of real and complex conjugates. However, in most engineering applications we are 
interested in the nature of the poles. We will consider the nature of the poles for each case. 

Case I: Distinct Poles 


If all the poles p L , p 2 , p 3 , ..., p n of F(s) are distinct (different from each another), we can factor 
the denominator of F(s) in the form 


F(s) 


_N00_ 

(s - Pi) - (s - p 2 ) - (s - p 3 ) ■ ... -(s-Pn) 


(12.4) 


where p k is distinct from all other poles. Then, the partial fraction expansion method allows us to 
express (12.4) as 


F(s) = - 


(12.5) 


(S-Pi) (s-p 2 ) (s-p 3 ) (s-p n ) 

where r t , r 2 , r 3 , ..., r n are the residues of F(s). 

To evaluate the residue r k , we multiply both sides of (12.5) by (s - p k ); then, we let s —> p k , that 


r k = lim (s-p k )F(s) = (s - p k )F(s)| s = 


( 12 . 6 ) 


Example 12.1 

Use partial fraction expansion to simplify Fj(s) of (12.7) below. 


Solution: 


F t (s) 


3s + 2 
> 2 + 3s + 2 


_ 3s + 2 _ 3s + 2 _ r i + r 2 

" s 2 + 3s + 2 " (s+l)(s + 2) " (s+1) (s + 2) 


r i 


lim (s+l)F(s) = ^±2 I =-l 
« >-l (s + 2)| s = _j 


(12.7) 

( 12 . 8 ) 
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r 2 = lim (s + 2)F(s) = 

s -> -2 (s+1) 

Therefore, by substitution into (12.8), we obtain 


= 4 


We can us the MATLAB 
Ns = [3,2]; Ds = [1,3, 2]; 


Fi(s) = 


3s + 2 


(s + l) (S + 2) 


(12.9) 


s 2 + 3s + 2 

residue(r,p,k) function to verify our answers with the following script: 

[r, p, k] = residue(Ns, Ds) 


r = 

4 

-1 

P = 

-2 

-1 

k = 

□ 

where we have denoted Ns and Ds as two vectors that contain the numerator and denominator 
coefficients of Fj(s). MATLAB displays the r, p, and k vectors; these represent the residues, 
poles, and direct terms respectively. The first value of the vector r is associated with the first value 
of the vector p, the second value of r is associated with the second value of p, and so on. The vec¬ 
tor k is referred to as the direct term, and it is always empty (has no value) whenever F(s) is a 
proper rational function. For this example, we observe that the highest power of the denominator 
is s 2 whereas the highest power of the numerator is s and therefore, the direct term k is empty. 


Example 12.2 

Use partial fraction expansion to simplify F 2 (s) of (12.10) below. 

F 2 (s) = - 3s2 + 2s + 5 - (12.10) 

s 3 + 12s 2 + 44s+ 48 

Solution: 

First, we will use the MATLAB function factor(s) to express the denominator polynomial of 
F 2 (s) in factored form. This function returns an expression that contains the prime factors of a 
polynomial. However, this function is used with symbolic expressions. These expressions are 


* Of course, we can use the roots(p) function. The factor(s) function is a good alternative. 
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explained below. 

The functions, like roots(p), which we have used before, are display numeric expressions, that is, 
they produce numerical results. Symbolic expressions, on the other hand, can manipulate mathe¬ 
matical expressions without using actual numbers. Some examples of symbolic expressions are 
given below. 

sin 2 x e -at y = —-(3t 3 -4t 2 + 5t + 8) u = f-dx 
dt J x 

MATLAB contains the so-called Symbolic Math Toolbox. This is a collection of tools (functions) 
which are used in solving symbolic expressions; they are discussed in detail in MATLAB User’s 
Manual. For the present, our interest is in using the factor(s) to express the denominator of 
(12.10) as a product of simple factors. 

Before using symbolic expressions, we must create a symbolic variable x, y, s, t etc. This is done 
with the sym function. For example, s = sym (‘s’) creates the symbolic variable s. Alternately, 
we can use the syms function to define one or more symbolic variables with a single statement. 
For example, 

syms x y z al k2 

defines the symbolic variables x, y, z, al and k2. 

Returning to Example 12.2 and using MATLAB we have: 
syms s; den=s A 3+12*s A 2+44*s+48; factor(den) 
ans = 

(s+4)*(s+2)*(s+6) 
and thus, 


P (s) _ 3s + 2s + 5 _ 3s~ + 2s + 5 _ r i + r 2 + r 3 

s 3 + 12s 2 + 44s + 48 ” (s + 2)(s + 4)(s + 6) ” (s + 2) (s + 4) (s + 6) 
Next, we find the residues rj, r 2 , and r 3 . These are 


3s 2 + 2s+ 5 9 

3s 2 + 2s + 5 


37 

3s 2 + 2s + 5 

89 

r ‘ (s + 4)(s + 6) s = _ 2 8 

r2 (s + 2)(s + 6) 

s = -4 

"4 

r3_ (s + 2)(s + 4) [ 

i = -6~ 8 

Therefore, 






F 2 (s) = ■ 

i 

3s 2 + 2s+ 5 

9/8 

-37/4 

89/8 


i 3 + 12s 2 + 44s+ 48 

(s + 2) 

(s + 4) 

(s + 6) 
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Partial Fraction Expansion 


Case II: Complex Poles 

Quite often, the poles of a proper rational function F(s) are complex, and since complex poles 
occur in complex conjugate pairs, the number of complex poles is even. Thus if p k is a complex 
pole, then its complex conjugate p k * is also a pole. The partial fraction expansion method can 
also be used in this case, as illustrated by the following example. 


Example 12.3 

Use partial fraction expansion to simplify F 3 (s) of (12.11) below. 


Solution: 


F 3 (s) = 


s + 3 

s 3 + 5s 2 + 12s + 8 


(12.11) 


As a first step, we express the denominator in factored form to identify the poles of F 3 (s). Using 

the MATLAB script 

syms s; factor(s A 3 + 5*s A 2 + 12*s + 8) 

we obtain 


ans = 

(s+1)*(s A 2+4*s+8) 

Since the factor(s) function did not factor the quadratic term , we will use the roots(p) function 
to find its roots by treating it as a polynomial. 

p=[1 4 8]; roots_p=roots(p) 

roots_p = 

-2.0000+2.OOOOi 
-2.0000-2.OOOOi 

Then, 

F 3(S) = - 

s + 5s + 12s + 8 

_ _ s + 3 _ _ _ _ 

s 3 + 5s 2 + 12s + 8 ( s + 1 ) ( s + 2+ j 2 ) (s + 2-j2) 

and the residues are 


(s + l)(s + 2+j2)(s + 2-j2) 


( 12 . 12 ) 


* For some undocumented reason, the factor(s) function does not seem to work with complex numbers. 
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s + 3 I = 2 
s 2 + 4s + 8 | s = _ x 5 


s + 3 

l-j2 

1 - j2 

(s + l)(s + 2-j2) s 

2 _ j2 (— 1 j2)(—j4) 

-8+j4 

(l-j2) (- 8 -j4) 

— 16 + j 12 _ 1.3 


(- 8 + j4)(- 8 -j4) 

80 5 J 20 


s + 3 

l-j2 

1 - j2 

(s + l)(s + 2+j2) s _ 

_ 2+j2 (- 1 +j2)(j4) 

-8-j4 

(l-j2) (- 8 + j4) 

(-16)-jl2 _ 1 .3 


(-8-j4)(~8+j4) 

80 5 20 



Of course, the last evaluation was not necessary since r 3 = r 2 * or 



and this is always true since complex roots occur in conjugate pairs. Then, by substitution into 
(12.12), we obtain 


F ( s ) = 2/5 | -1/5+J3/20 | -1/5-J3/20 

3lS ' (s + 2) (s + 2+j2) (s + 2—j 2) 


(12.13) 


We can express (12.13) in a different form if we want to eliminate the complex presentation. 
This is done by combining the last two terms on the right side of (12.13) to form a single term and 
now is written as 


F 3 (s) = 


(s + 2) 


1 (2s + 1) 

5 (s 2 + 4s + 8) 


(12.14) 


Case III: Multiple (Repeated) Poles 

In this case, F(s) has simple poles but one of the poles, say p 2 , has a multiplicity m. Then, 

F(s) = ---^- (12.15) 

(s-p 1 ) m (s-p 2 )...(s-p n _ 1 )(s-p n ) 

and denoting the m residues corresponding to multiple pole p, as r n , r 12 , ... r lm , the partial 
fraction expansion of (12.15) can be expressed as 
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F(s) = ■ 


(s — P!) (S-Pj) (S-Pj) 


(s-Pi) 


(12.16) 


(s-p 2 ) (s-p 3 ) (s-p n ) 

For the simple poles p t , p 2 , ... p n we proceed as before, that is, 

r k = lim (s-p k )F(s) = (s-p k )F(s)| 

s Pk ls -Pk 

To find the first residue r n of the repeated pole, we multiply both sides of (12.16) by (s - p, ) m 
Then, 

(s-Pi)“F(s) = r 11 + (s-p I )r 12 + (s-p 1 ) 2 r 13 + ... + (s-p 1 ) m-I r lm 


+ (s-Pi) 


V (s-p 2 ) + (s-p 3 ) + "' + (s-p n )) 
Next, taking the limit as s -» Pl on both sides of (12.17), we obtain 
Jim (s-p!) m F(s) 

= r n + s 1 ™ [( s -Pi)r 12 + (s-p 1 ) 2 r 13 + ... + (s-p 1 ) m_1 r lm ] 

+ lim|"(s-p 1 ) f -—-—- + -—-—- + 

s^. Pl L Hs-P 2 ) (s-P 3 ) (s- Pn yJ 


(12.17) 


(12.18) 


= I™ (s- Pl ) m F(s) 


(12.19) 


and thus (12.19) yields the residue of the first repeated pole. 

To find the second residue r 12 of the second repeated pole p,, we first differentiate the relation of 
(12.18) with respect to s ; then, we let s -» p L , that is, 

r 12 = lim j-[(s - Pl ) m F(s)] (12.20) 

s — ^ p! as 

To find the third residue r 13 of the repeated pole p,, we differentiate (12.18) twice with respect 
to s ; then, we let s -» Pl , that is, 


r i 3 = lim —rKs - Pl ) F(s)] 
s_>Pl ds 


( 12 . 21 ) 
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This process is continued until all residues of the repeated poles have been found. 
In general, for repeated poles the residue r lk can be derived from the relation 

(s-pi) m F(s) = % + r 12 (s~p 1 ) + r 13 (s~p 1 ) 2 + ... 
whose (m- l)th derivative of both sides is 


(k- 1 )!r ik = lim —^[(s-pj) F(s)] 

s_> Pi ds 


r ' l = , 1 T Pl (k^Tj!^ [(s - p ‘ rF(s)I 


( 12 . 22 ) 


(12.23) 


(12.24) 


Example 12.4 

Use partial fraction expansion to simplify F 4 (s) of (12.25) below. 


1 4v / _ 7 

(s + 2)(s + l) 2 

Solution: 


(12.25) 


We observe that there is a pole of multiplicity 2 at s = -1 and thus, (12.25) in partial fraction 
expansion form is 


F 4 (s) = 


s + 3 


The residues are 


(s + 2)(s + l) 2 ( s + 2 ) (s+1) 2 ( s+1 ) 

s + 3 


= 1 


(s + 1) | 

r = 5+3 I 

21 ( s + 2 )ls = -l 

_ d ( s + 3 ^ 
r22 " ds v s + 2 2 

Then, by substitution into (12.26), 

F 4 (s) = 


= 2 


= (s + 2) - (s + 3) 1 
i (s + 2) 2 I 


(s + 2)(s + l) 2 ( s + 2 ) (s+1) 2 ( s+1 ) 


(12.26) 
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Instead of differentiation, the residue r 22 could be found by substitution of the already known 
values of rj and r 21 into (12.26), and letting s = 0 , that is, 


s + 3 

1 1 

I 2 1 

+ 

( s + 1 ) 2 ( s + 2) 

(s + 2) 

s = 0 

s = 0 (s+1) 2 

(s+1) 

s = 0 


or 3/2 = l/2 + 2 + r 22 from which r 22 = -1 as before. 

To check our answers with MATLAB, we will use the expand(s) function. Like the factor(s) 
function, expand(s) is used with symbolic expressions. Its description can be displayed with the 

help expand command. 

Check with MATLAB: 

syms s % Create symbolic variable s 

expand((s + 1) A 2) % Express it as a polynomial 

ans = 
s A 2+2*s+l 

Ns = [1 3]; % Coefficients of the numerator N(s) 

dl = [1 2 1]; % Coefficients of (s + 1) A 2 = s A 2 + 2*s + 1 term in D(s) 

d2 = [0 1 2]; % Coefficients of (s + 2) term in D(s) 

Ds=conv(d1 ,d2); % Multiplies polynomials dl and d2 to express denominator D(s) as polynomial 
[r,p,k]=residue(Ns,Ds) 


1.0000 

- 1.0000 

2.0000 

p - 

- 2.0000 

- 1.0000 

- 1.0000 

k = 

□ 


Example 12.5 

Use partial fraction expansion to simplify F 5 (s) of (12.27) below. 


*We must remember that (2.45) is an identity, and as such, it is true for any value of s. 
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F 5 (s) = 


s 2 + 3s+ 1 
(s+ l) 3 (s + 2) 2 


(12.27) 


Solution: 

We observe that there is a pole of multiplicity 3 at s = -1, and a pole of multiplicity 2 at s = -2. 
Then, in partial fraction expansion form 


F 5 (s) = ^1^ + ^^ + ^^ + ^^ + ^- 
5 (s +1) 3 (s +1) 2 (* +1 ) (s + 2) 2 (b + 2) 

We find the residue r n by evaluating F 5 (s) at as s = -1 


(12.28) 


r„ = s2 + 3s+1 = -1 (12.29) 

( s+2 > L— 

The residue r 12 is found by first taking the first derivative of F 5 (s), and evaluating it at s = -1. 
Thus, 


d f s 2 + 3s + 1 
ds l (s + 2) 2 

_ (s + 2) 2 (2s + 3)—2(s + 2)(s 2 + 3s + 1) 1 = s + 4 

(s + 2) 4 (s + 2) 3 


(12.30) 


The residue r 13 is found by taking the second derivative of F 5 (s) and evaluating it at s = -1. 
Then, 


1 d s +3s + 1 


ds V (s + 2) 


ld[ 

df 

s 2 + 3 s + i'll 

2 ds | 

ds^ 

(s + 2) 2 JJ 


Id f s+4 

2dsV (s + 2) 3 


s + 2 — 3s — 12 TI 
^ (s + 2) 4 \ 


1 [~ (s + 2) 3 - 3(s + 2) 2 (s + 4) 
"2L (s + 2) 6 


- s - 5 

(s + 2 ) 4 | s= i 


= -4 


(12.31) 


Similarly, the residue r 21 if found by evaluating F 5 (s) at s = -2, and the residue r 22 is found by 
first taking the first derivative of F 5 (s) and evaluating it at s = -2 . Therefore, 
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r 21 




r 22 


2 _ ,1 

S + 3S + 1 = 1 

( S + 1 > 3 Js = -2 

dfs 2 + 3s + I'] 

4 (s + 1) 3 J 2 

(s + 1) 3 (2s + 3) - 3(s + l) 2 (s 2 + 3s + 1) 1 

( S+1 > 6 |g - _ 2 

(s+ 1)(2s + 3)-3(s 2 + 3s+ 1) 1 = — s 2 — 4s I 

( S+1 ) 4 s = -2 ( S+1 ) 4 | s = -2 


By substitution of these residues into (12.28), we obtain F 5 (s) in partial fraction expansion as 


F 5 (s) = 


(s+1) 3 (s+1) 2 ( s + 1 ) (s + 2) 2 ( s + 2 ) 


(12.32) 


We will now verify the values of these residues with MATLAB. Before we do this, we introduce 
the collect(s) function that we can use to multiply two or more symbolic expressions to obtain 
the result in a polynomial form. Its description can be displayed with the help collect command. 
We must remember that the conv(p,q) function is used with numeric expressions, i.e., polyno¬ 
mial coefficients only. 

The MATLAB script for this example is as follows. 

syms s; % We must first define the variable s in symbolic form 

% The function "collect" below multiplies (s+1) A 3 by (s+2) A 2 
Ds=collect(((s+1 ) A 3)*((s+2) A 2)) 

Ds = 

s A 5+7*s A 4+19*s A 3+25*s A 2+16*s+4 


% We now use this result to express the denominator D(s) as a 
% polynomial so we can use its coefficients with the "residue" function 

% 

Ns=[1 3 1]; Ds=[1 7 19 25 16 4]; [r,p,k]=residue(Ns,Ds) 


4.0000 

1.0000 

-4.0000 

3.0000 

- 1.0000 
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P - 

- 2.0000 

- 2.0000 

- 1.0000 

- 1.0000 

- 1.0000 

k = 

[] 


Case for m > n 

Our discussion thus far, was based on the condition that F(s) is a proper rational function, that 
is, the highest power m of the numerator is less than the highest power n of the denominator, 
i.e., m < n. If m > n, F(s) is an improper rational function, and before we apply the partial frac¬ 
tion expansion, we must divide the numeraror N(s) by the denominator D(s) to obtain an 
expression of the form 

F(s) = k 0 + k 1 s + k 2 s 2 + ...+k m _ n s m_n + ^ (12.33) 

so that m < n. 


Example 12.6 

Express F 6 (s) of (12.34) below in partial expansion form. 

F (s ) = s 2 + 2s + 2 (12 .3 4 ) 

s + 1 

Solution: 

In (12.34), m > n and thus we need to express F 6 (s) in the form of (12.33). By long division, 

p = s 2 + 2s + 2 = _L. + s + i (12.35) 

s + 1 s + 1 

Check with MATLAB: 

Ns = [1 2 2]; Ds = [1 1]; [r, p, k] = residue(Ns, Ds) 

r = 

1 

P = 

-1 

k = 

1 1 
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The direct terms k = [1 7] are the coefficients of the s term and the constant in (2.54). 


12.2 Alternate Method of Partial Fraction Expansion 

The partial fraction expansion method can also be performed by the equating the numerators proce¬ 
dure thereby making the denominators of both sides the same, and then equating the numerators. 
We assume that the degree on the numerator N(s) is less than the degree of the denominator. If 
not, we first perform a long division and then work with the quotient and the remainder as 
before. 

We also assume that the denominator D(s) can be expressed as a product of real linear and qua¬ 
dratic factors. If these assumptions prevail, we let s - a be a linear factor of D(s) and we suppose 
that (s - a) m is the highest power of s - a that divides D(s). Then, we can express F(s) as 



(12.36) 


Next, let s 2 + as + p be a quadratic factor of D(s) and suppose that(s 2 + as + P) n is the highest 
power of this factor that divides F(s). Now, we perform the following steps: 


1. To this factor, we assign the sum of n partial fractions as shown below. 

r.s + k, r 2 s + k 2 r n s + k n 

-i-L_-i-r-±-+ -i-2-2- 


(12.37) 



2. We repeat Step 1 for each of the distinct linear and quadratic factors of D(s). 

3. We set the given F(s) equal to the sum of these partial fractions. 

4. We multiply each term of the right side by the appropriate factor to make the denominators of 
both sides equal. 

5. We arrange the terms of both sides in decreasing powers of s. 

6. We equate the coefficients of corresponding powers of s. 

7. We solve the resulting equations for the residues. 

Example 12.7 

Express F 7 (s) of (12.38) below as a sum of partial fractions using the equating the numerators 
procedure. 
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F 7 00 = ■ 


- 2s + 4 _ r i s + A [ r 21 | r 22 


(s + l)(s-l) 

Solution: 

By Steps 1 through 3 above, 

FyOO = ■ 2 2-2 ■ 2 ■ n 

(s +l)(s-l) (s' +1) (s - 1 ) 

By Step 4, 

-2s+ 4 = (rjs +A)(s-l) 2 + r 21 (s 2 +l) + r 22 (s-l)(s 2 +1) 
and by Steps 5, 6, and 7, 

-2s+ 4 = (r x +r 22 )s 3 + (-2r L + A-r 22 + r 21 )s 2 
+ (r x - 2A + r 22 )s + (A - r 22 + r 21 ) 


(12.38) 

(12.39) 

(12.40) 

(12.41) 


Relation (12.41) is an identity in s; therefore, the coefficients of each power of s on the left and 
right sides are equal. Accordingly, by equating like powers of s, we obtain 


0 = rj + r 22 

0 = -2rj + A-r 22 + r 21 
-2 = rj - 2A + r 22 
4 = A - r 22 + r 21 

Subtracting the second equation from the fourth in (12.42), we obtain 
4 = 2rj or r x = 2 

and by substitution into the first equation of (12.42), we obtain 
0 = 2 + r 22 or r 22 = -2 

Next, substitution of (12.43) and (12.44) into the third equation of (12.42), yields 
-2 = 2-2A-2 or A = 1 
and using the fourth equation of (12.42, we obtain: 

4 = 1 + 2 + r 21 or r 21 = 1 

Therefore F 7 (s) in partial fraction expansion form becomes 

tj , s. _ -2s + 4 _ 2s + 1 , 1 2 

^ytSj - ~z - 


(12.42) 

(12.43) 

(12.44) 

(12.45) 

(12.46) 
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Example 12.8 

Use the equating the numerators procedure to obtain the partial fraction expansion of F 8 (s) in 
(12.47) below. 

s + 3 


F 8 (s) = ■ 


(12.47) 


+ 5s + 12s + 8 


Solution: 

This is the same rational function as that of Example 12.3, where we found that the denominator 
can be expressed in factored form of a linear and a quadratic factor, that is, 


F 7 (s) = ■ 


s + 3 


(s + l)(s +4s + 8) 

and in partial fraction expansion form, 

F,(s) =-- = Jj_ + _££1£3_ 

(s + l)(s 2 + 4s + 8) s + 1 s 2 + 4s + 8 

As in Example 12.3, we first find the residue of the linear factor as 


s + 3 


(12.48) 


(12.49) 


(12.50) 


To compute r 2 and r 3 , we use the equating the numerators procedure and we obtain 

(s + 3) = rj(s 2 + 4s + 8) + (r 2 s+ r 3 )(s + 1) (12.51) 


Since r, is already known, we only need two equations in r 2 and r 3 . Equating the coefficient of 
s 2 on the left side, which is zero, with the coefficients of s 2 on the right side of (12.51), we obtain 
0 = rj + r 2 (12.52) 


With r, = 2/5, (12.52) yields r 2 = -2/5 . To find the third residue r 3 , we equate the constant 
terms of (12.51), that is, 3 = 8rj + r 3 , and with r t = 2/5 , we obtain r 3 = -1/5 . Then, by substi¬ 
tution into (12.49), we obtain 


F 7 (s) 


2/5 1 (2s+1) 

(s + 2) 5( s 2 + 4s + 8) 


as before. The remaining steps are the same as in Example 12.3. 

We will conclude the partial fraction expansion topic with a few more examples, using the resi- 
due(r,p,k) function. 
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Example 12.9 

Use the residue(r,p,k) function to compute the poles and residues of the function 

F 9 (s) = , 8s + 2 (12.53) 

s + 3s + 2 

Solution: 


Let pj and p 2 be the poles (the denominator roots) and r, and r 2 be the residues. Then, F 9 (s) 
can be written as 


F 9 (S) = ; 


(12.54) 


The MATLAB script for this example is as follows: 

num=[0 8 2]; % The semicolon suppress the display of the row vector typed 

% and zero is typed to make the numerator have same number 
% of elements as the denominator; not necessary, but recommended 
den=[1 3 2]; [r,p,k]=residue(num,den) 


P = 

k = 


14 

-6 

-2 

-1 

□ 


Therefore, F 9 (s) in partial fraction expansion form is written as 


F 9 (s) = - 


(12.55) 


Example 12.10 

Use the residue(r,p,k) function to compute the poles and residues of F 10 (s) in (12.56) below. 

Fjo(s) = -^- (12.56) 

(s+ l)(s +4s + 8) 

Solution: 

Let P[, p 2 , and p 3 be the poles (the denominator roots) and r x , r 2 ,and r 3 be the residues of 
F 10 (s). Then, it can be written as 
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Alternate Method of Partial Fraction Expansion 


FioOO = - 


s + p 2 s+p 3 


(12.57) 


The poles and the residues can be found with the statement [r,p,k]=residue(num, den). Before 
we use this statement, we need to express the denominator as a polynomial. We will use the func¬ 
tion conv(a,b) to multiply the two factors of the denominator of (12.56). 

We recall that we can write two or more statements on one line if we separate them by commas 
or semicolons. We also recall that commas will display the results, whereas semicolons will sup¬ 
press the display. Then, 

a=[1 1 ]; b=[1 4 8]; c=conv(a,b); c, num=[1,3]; den=c; 

[r,p,k]=residue(num,den) 


c = 


1 

5 12 

-0.2000- 

0.1500i 

-0.2000+ 

0.1500i 

0.4000 


-2.0000+ 

2 . OOOOi 

-2.0000- 

2.OOOOi 

- 1.0000 



k = 

□ 


Therefore, F 10 (s) in partial fraction expansion form is 


FioOO = ' 


r 2 

s + p 2 


r 3 

s + p 3 


-0.2-0.15j t - 0.2 +0.15j t 0.4 
s + 2-2j s + 2 + 2j s+1 


(12.58) 


By repeated use of the deconv(num,den) function, we can reduce a rational polynomial to sim¬ 
ple terms of a polynomial, where the last term is a rational polynomial whose order of the numer¬ 
ator is less than that of the denominator as illustrated by the following example. 


Example 12.11 

Use the deconv(num,den) function to express the following rational polynomial as a polynomial 
with four terms. 


fi(x) = 


3-2 . 

x + 2x + 1 

0.5x - 1 


(12.59) 
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Solution: 

num=[1 2 0 1]; den=[0 0 0.5 -1]; [q,r]=deconv(num,den) 

q = 

2 8 16 

r = 

0 0 0 17 

Therefore, f, (x) can now be written as 

f, (x) = 2x 2 + 8x + 16 + —(12.60) 

1 0.5x-l 

It is important to remember that the function roots(p) is used with polynomials only. If we want 
to find the zeros of any function, such as the function f 2 (x) defined as 

f 2(x) = _3ii±2d±i- + 0.5xW + 4.35 + _l (12.61) 

(12x +2x +13x +25) (23x + 16x +7.5x) 4.11x + 2.75 

we must use the function fzero(‘function’,Xo), where function is a pre-defined string, and x 0 is a 
required initial value. We can approximate this value by first plotting f 2 (x) to find out where it 
crosses the x-axis. This is discussed in Chapter 1, Page 1-27. 
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Summary 


12.3 Summary 

• The function 

_ N(S) _ b m sm + b m-l sm l +b m-2 sm 2+ +b l S + b 0 

Dfsi n n-1 n-2 

t 3 ; a n s +a n _jS +a n _ 2 s +...+ajS + a 0 

where the coefficients a k and b k for k = 0, 1, 2, n are real numbers, is a proper rational 
function if the highest power of the numerator N(s) is less than the highest power of of the 
denominator D(s), i.e., m < n. If m > n , F(s) is an improper rational function. 

• Partial fraction expansion applies only to proper rational functions. If F(s) is an improper 
rational function we divide the numeraror N(s) by the denominator D(s) to obtain an expres¬ 
sion of the form 

F(s) = k n + k,s + k 7 s 2 + ... + k m s m_n + ^^ 

0 1 2 m-n D(s) 

so that m < n. 

• If the function 

F( s ) = N(s) = b m sm + b m^l sm ~ 1+b m^ 2 sm ~ 2 + +b l S + b 0 
D( s ) a n s n + a n _ jS 11-1 + a n _ 2 s n ^ 2 + ... + ajS + a 0 


is a proper rational function where a n is a non-zero integer other than unity, we rewrite this 
function as 


F ( s) = m = i 


—(b m s +b m 


. + bjS + b 0 ) 


D(s) 


to make a n unity. 

• The roots of the numerator are called the zeros of F(s), and are found by letting N(s) = 0, 
and the roots of the denominator are called the poles of F(s) and are found by letting 
D(s) = 0. 

• The zeros and poles can be real and distinct, or repeated, or complex conjugates, or combina¬ 
tions of real and complex conjugates. In most engineering applications we are interested in the 
nature of the poles. 

• If all the poles p 1? p 2 , p 3 , ..., p n of F(s) are distinct we can factor the denominator of F(s) 
in the form 
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F(s) = -^- 

(s - Pi) • (s-p 2 ) ■ (s — p 3 ) ■ ... • (s — p n ) 

where p k is distinct from all other poles. Then, the partial fraction expansion method allows 
us to write the above expression as 

r, r, r, r„ 

F(s) = -i— +--— +--— + ... +-2— 

(s — P!) (S — p 2 ) (s — P 3 ) (S-P n ) 

where r l5 r 2 , r 3 , ..., r n are the residues of F(s). To evaluate the residue r k , we multiply both 
sides of (12.5) by (s - p k ); then, we let s -> p k , that is, 

r k = lim (s -p k )F(s) = (s-p k )F(s)| 

s->p t !s=Pk 

• We can use the MATLAB residue(r,p,k) function to verify our answers. This function returns 
the residues, their associated poles, and a direct term. For proper rational functions there is no 
direct term. 


• The partial fraction expansion can also be used if the poles are complex. Since complex poles 
occur in conjugate pairs, if p k is a complex pole, then its complex conjugate p k * is also a pole. 

• If a rational function F(s) has simple poles but one of the poles, say p, , has a multiplicity m, 
the function is expressed as 


(s-p 1 ) m (s-p 2 )...(s-p n _ 1 )(s-p n ) 

and denoting the m residues corresponding to multiple pole p, as r n , r 12 , ... r lm , the partial 
fraction expansion can be expressed as 


F(s) 


r n 

(s - Pi) m 


_ r l2 

(s - Pi) 1 


f—^2- 

(s-Pi)' 

(s-p 2 ) 


r 3 

(s-p 3 ) 


r lm 

(s-Pi) 

r n 

(S-P n ) 


• If a rational function F(s) has simple poles but one of the poles, say p ,, has a multiplicity m, 
for the simple poles we use the same procedure as for distinct poles. The first residue of a 
repeated pole is found from 

r n = lim (s-pj^Ffs) 

S—»Pl 


The second repeated pole is found from 
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Summary 


r 12 = lim j-[(s-Pi) m F(s)] 

s->p,ds 

the third from 

r 13 = lim ^[(s- Pl ) m F(s)] 

S^p, ds ^ 

and this process is continued until all residues of the repeated poles have been found. 

• With the alternate method of partial fraction expansion we use the equating the numerators 
procedure thereby making the denominators of both sides the same, and then equating the 
numerators. We assume that the denominator D(s) can be expressed as a product of real lin¬ 
ear and quadratic factors. 
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12.4 Exercises 

Perform partial fraction expansion for the following. Use MATLAB to simplify and to verify your 
results. 


5-28-3 
5s - 3 


s +2s + 1 
1 

s(s + l) 2 
1 

' (s + l)(s 2 + l) 
1 

s(s + s + 1) 
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Solutions to End-of-Chapter Exercises 


12.5 Solutions to End-of-Chapter Exercises 


l_s 2 S 2 _1 (s+l)(s-l) s + 1 s-1 


s + 1 


= -1/2 r 7 = - 


s - 1 


Then, 


1/2 i 1/2 
s+1 s-1 


-1 . 

S 2 -1 

Ns = [0, 0, -1]; Ds = [1,0, -1]; [r, p, k] = residue(Ns, Ds) 
r = 

0.5000 

-0.5000 


-1 

1 


Then, 


s 2 + 4 s-5 (s — 1 )(s + 5) s-1 s + 5 

1 I _ i /* „ = J_| 

s - 11 _ . 


format rat; Ns = [0, 0, 1]; Ds = [1,4, -5]; [r, p, k] = residue(Ns, Ds) 

r = 

- 1/6 

1/6 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


12-23 









Chapter 12 Partial Fraction Expansion 


3. 


Then, 


s _ _s_ 

5 2 _2s- 3 ” ( s + l)(s-3) 


s + 1 s - 3 


s 

s-3 


1/4 


s I 

s + 1 | 


3/4 


s = 1/4 { 3/4 
s 2 -2s - 3 8 + 1 s “ 3 


format rat; Ns = [0, 1,0]; Ds = [1, -2, -3]; [r, p, k] = residue(Ns, Ds) 


P - 

k = 


4. 


3/4 

1/4 

3 

-1 

[] 


Then, 


5s - 3 = 5s - 3 = *i . r 2 

5 2 _2s-3 (s + 1 )(s — 3) s + 1 s-3 


■ 5s - 3 1 
s-3 


5s - 3 = 2 | 3 

> 2 -2s - 3 S + 1 s_3 


Ns = [0, 5, -3]; Ds = [1, -2, -3]; [r, p, k] = residue(Ns, Ds) 
r = 

3 

2 

P = 

3 

-1 

k = 

[] 
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This is an improper rational function, and before we apply the partial fraction expansion, we 
must divide the numeraror N(s) by the denominator D(s) to obtain an expression of the form 

F(s) = k n + k,s + k 7 s 2 + ... + S m_n + M(£) 

0 1 2 m-n D(s) 

We could perform long division but we will use the MATLAB deconv(num,den) function to 
express the following rational polynomial as a polynomial with four terms. 

num=[1 0 0];den=[1 2 1]; [q,r]=deconv(num,den) 

q - 

1 

r = 

0 -2 

and thus 

2 s2 =1+ - 2S - 1 
s+2s + l s+2s+l 


-1 

1 - 2 "! = 1 -^- + -^- 
(s + 1) 2 (s + 1) 2 ( s+1 ) 


-2s - 1 = t x + r 2 (s + 1) 


(s + 1) 2 (s+1) 2 ( s + 1 ) 

r 2 = -2 rj + r 2 = -1 r, = 1 


Then, 


s 2 + 2s + 1 s 2 + 2s + 1 (s + 1) 2 ( s + 1) 

Ns = [1,0, 0]; Ds = [1,2, 1]; [r, p, k] = residue(Ns, Ds) 


-2 

1 


-1 

-1 


s(s + 1 ) 2 s (s + 1) 2 ( s + 1 ) 
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Then, 


s(s+l) 2 s (s + 1) 2 ( s + 1 ) 

syms s; expand(s*(s+1) A 2) 

ans = 

s /s 3+2*s / ''2 + s 

Ns = [0, 0, 0, 1]; Ds = [1,2, 1,0]; [r, p, k] = residue(Ns, Ds) 


r = 


P ^ 


k = 


7. 


-1 

-1 

1 

-1 

-1 

0 

[] 


1 

(s + l)(s 2 +l) 


r i | r 2 s + r 3 = r i(s 2 + 1) | (r 2 s + r 3 )(s+1) 

+ 1 s 2 +l (s + l)(s 2 + l) (s + l)(s 2 +l) 


Equating numerators and like terms we obtain 

i 2 2 

1 = rjS +rj+r 2 s +r 2 s + r 3 s + r 3 
r t + r 2 = 0 r 2 + r 3 = 0 r t + r 3 = 1 


= -1 


syms ri r2 r3 
eq1=r1+r2-0 
eq2=r2+r3-0 
eq3=r1 +r3-1 
S=solve(eq1, eq2, eq3) 
eql = 
rl+r2 

eq2 = 
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r2+r3 

eq3 = 
rl+r3-l 

S - 


rl: 

[lxl 

sym] 

r2 : 

[lxl 

sym] 

r3 : 

[lxl 

sym] 


S.rl 

ans = 

1/2 

S.r2 

ans = 

- 1/2 

S.r3 

ans = 

1/2 

The statement S=solve(eq1, eq2, eq3, ...eqN) returns the solutions in the structure S whose 
named fields hold hold the solution for each variable. Thus, rj = 1/2, r 2 = -1/2, and 
r 3 = 1/2. Then, 


1 = 1/2 j (~l/2)s + 1/2 

(s+l)(s 2 +l) S+1 S 2 +1 

syms s; expand((s+1)*(s A 2+1)) 
ans = 

s /s 3+s + s / '2 + l 

Ns = [0, 0, 0,1]; Ds = [1, 1, 1, 1]; [r, p, k] = residue(Ns, Ds) 

r = 

1/2 

-1/4 - l/4i 
-1/4 + l/4i 

P = 

-1 

-1/6004799503160662 + li 
-1/6004799503160662 - li 

k = 

11 
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These values are inconsistent with those we’ve found. The MATLAB help residue com¬ 
mand displays the following: 

Warning: Numerically, the partial fraction expansion of a ratio of 
polynomials represents an ill-posed problem. If the denominator 
polynomial, A(s), is near a polynomial with multiple roots, then 
small changes in the data, including roundoff errors, can make arbi¬ 
trarily large changes in the resulting poles and residues. Problem 
formulations making use of state-space or zero-pole representations 
are preferable. 


1 


r 2 s + r 3 r i (s +s+l) (r 2 s + r 3 )s 


s(s +S + 1) S S +S + 1 s(s +S + 1) s(s +S + 1) 
Equating numerators and like terms we obtain 

1 = r 1 s 2 + r 1 s+r 1 +r 2 s 2 + r 3 s 
r i + r 2 = 0 r 2 + r 3 = 0 r 3 = 1 
By inspection, r, = 1, r 2 = -1, and r 3 = 1. Then, 

1 _ 1 - s + 3 


(s+ l)(s + 1) 


s + s + 1 


syms s; expand(s*(s A 2+s+1)) 

ans = 

s''3 + 3^2 + s 

Ns = [0, 0, 0, 1]; Ds = [1,1,1,0]; [r, p, k] = residue(Ns, Ds) 

r = 

-1/2 + 390/135H 

-1/2 - 390/135H 

1 

P ^ 

-1/2 + 1170/1351i 
-1/2 - 1170/1351i 
0 

k - 

□ 

As in Exercise 7, these values are inconsistent with those we’ve found. 
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Chapter 13 


The Gamma and Beta Functions and Distributions 


T his chapter is an introduction to the gamma and beta functions and their distributions used 
with many applications in science and engineering. They are also used in probability, and in 
the computation of certain integrals. 


13.1 The Gamma Function 

The gamma function, denoted as T(n), is also known as generalized factorial function. It is defined as 


T(n) = f x n [ e X dx 

J o 


(13.1) 


and this improper integral converges (approaches a limit) for all n > 0 . 

We will derive the basic properties of the gamma function and its relation to the well known fac¬ 
torial function 

n! = n(n- l)(n — 2)...3-2-1 (13.2) 


We will evaluate the integral of (13.1) by performing integration by parts using the relation 


Letting 


judv = uv-jvdu 


we obtain 


u = e x and dv = x n 


du = -e X dx and v = — 
n 


(13.3) 

(13.4) 

(13.5) 


Then, with (13.3), we write (13.1) as 


* Improper integrals are two types and these are: 

a. | f(x)dx where the limits of integration a or b or both are infinite 

b. | f(x)dx where f(x) becomes infinite at a value x between the lower and upper limits of integration inclusive. 
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Chapter 13 The Gamma and Beta Functions and Distributions 


F(n) = +-fxV x dx (13.6) 

n lx = 0 nJ 0 

With the condition that n > 0, the first term on the right side of (13.6) vanishes at the lower limit, 
that is, for x = 0. It also vanishes at the upper limit as x —> °°. This can be proved with L’ Hopi- 
tal’s rule by differentiating both numerator and denominator m times, where m > n .Then, 


d n 


lim ^-£_ = lim - | im dx 


= lim 


dx 


lim 


ne x_> “ d x x_> “ d 

-ne - 

dx dx 

n(n- l)(n-2)...(n-m+ l)x n ~ m 


= Ijm (H-DCH-^Tn-m+D.Q 

x ->=o x™ n e 

Therefore, (13.6) reduces to 


r(n) = ni 

nJ r 




x e dx 


and with (13.1) we have 


T(n) = f x n l e X dx = -f x”e X dx 
J o nJ o 

By comparing the two integrals of (13.9), we observe that 


nT(n) = T(n+ 1) 


(13.7) 


(13.8) 

(13.9) 


(13.10) 

(13.11) 


* Quite often, the ratio of two functions, such as some value of x, say a, results in the indeterminate form 

- . To work around this problem, we consider the limit lim , and we wish to find this limit, if it exists. L’Hopi- 
g(a) 0 y x—»a g(x) ’ J y 

tal’s rule states that if f(a) = g(a) = 0, and if the limit ^f(x)/-j^g(x) as x approaches a exists, then, 

w. “ = 1™. (s t(x)/ l s(x) ) 
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The Gamma Function 


It is convenient to use (13.10) for n < 0, and (13.11) for n > 0. 
From (13.10), we see that T(n) becomes infinite as n —> 0 . 

For n = 1, (13.1) yields 

F(l) = f e" x dx = -e" x | 0 = 1 
J o 

Thus, we have derived the important relation, 

F(l) = 1 

From the recurring relation of (13.11), we obtain 

F(2) = 1 • F(l) = 1 
T(3) = 2 • T(2) = 2-1 =2! 
T(4) = 3 • T(3) = 3-2 = 3! 

and in general 

T(n + 1) = n! for n = 1,2,3, ... 


(13.12) 


(13.13) 


(13.14) 


(13.15) 


The formula of (13.15) is a very useful relation; it establishes the relationship between the T(n) 
function and the factorial n!. 


We must remember that, whereas the factorial n! is defined only for zero (recall that 0! = 1) 
and positive integer values, the gamma function exists (is continuous) everywhere except at 0 
and negative integer numbers, that is, -1, -2, -3 , and so on. For instance, when n = -0.5 , we can 
find T(-0.5) in terms of T(0.5) , but if we substitute the numbers 0,-1, -2, -3 and so on in 
(13.11), we obtain values which are not consistent with the definition of the T(n) function, as 
defined in that relation. 

Stated in other words, the T(n) function is defined for all positive integers and positive fractional val¬ 
ues, and for all negative fractional, but not negative integer values. 

We can use MATLAB’s gamma(n) function to plot T(n) versus n. This is done with the script 
below which produces the plot shown in Figure 13.1. 

n=-4: 0.05: 4; g=gamma(n); plot(n,g); axis([-4 4 -6 6]); grid; 
title('The Gamma Function 1 ); xlabelCn 1 ); ylabel('Gamma(n)') 

Figure 13.1 shows the plot of the function T(n) versus n. 
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Figure 13.1. Plot of the gamma function 

Numerical values of r(n) for 1 <n<2, can be found in math tables, but we can use (13.10) or 
(13.11) to compute values outside this range. Of course, we can use MATLAB to find any valid 
values of n. 


Example 13.1 

Compute: 

Solution: 

a. From (13.11) 

Then, 

and from math tables 
Therefore, 

b. From (13.10) 

Then, 


i. T(3.6) b. T(0.5) c. T(-0.5) 


T(n+ 1) = nT(n) 

T(3.6) = 2.6T(2.6) = (2.6)(1.6)T(1.6) 
T(1.6) = 0.8953 

T(3.6) = (2.6)(1.6)(0.8953) = 3.717 


F(n) 


n) = nE±l) 


rro 5) = F(0-5 + 1) _ T(l,5) 
0.5 0.5 
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The Gamma Function 

and from math tables 
Therefore, 

c. From (13.10) 

Then, 

T( 

and using the result of (b) 

T(-0.5)= -2T(0.5) = (-2) (1.772) = -3.544 
We can verify these answers with MATLAB as follows: 

a=gamma(3.6), b=gamma(0.5), c=gamma(-0.5) 
a = 

3.7170 

b = 

1.7725 

c = 

-3.5449 


T(1.5) = 0.8862 
T(0.5) = (2)(0.8862) = 1.772 

T(n) = F(n n + 

-0.5) = r (-°- 5 + 1 ) = mil = _ 2 r ( 0.5) 

' -0.5 -0.5 ' 


Excel does not have a function which evaluates T(n) directly. It does, however, have the GAM- 
MALN(x) function. Therefore, we can use the EXP(GAMMALN(n)) function to evaluate T(n) at 
some positive value of n. But because it first computes the natural log, it does not produce an 
answer if n is negative as shown in Figure 13.2. 

exp(gammaln(x))= 
x gammaln(x) gamma(x) 

3.6 1.3129 3.7170 

0.5 0.5724 1.7725 

-0.5 #NUM! #NUM! 

Figure 13.2. Using Excel to find T(n) 
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Example 13.2 

Prove that when n is a positive integer, the relation 

r(n) = (n - 1)! (13.16) 


is true. 

Proof: 

From (13.11), 


T(n+1) = nT(n) 

Then, 

(13.17) 

F(n) = (n-l)T(n-l) 

Next, replacing n with n - 1 on the left side of (13.18), we obtain 

(13.18) 

T(n-l) = (n - 2)T(n - 2) 

Substitution of (13.19) into (13.18) yields 

(13.19) 

F(n) = (n - l)(n - 2)T(n - 2) 

By n repeated substitutions, we obtain 

(13.20) 

F(n) = (n-l)(n-2)(n-3)...lT(l) 

and since T(l) = 1, we have 

(13.21) 

F(n) = (n- l)(n-2)(n-3)... 1 

or 

(13.22) 

F(n) = (n - 1)! 

(13.23) 


Example 13.3 

Use the definition of the T(n) function to compute the exact value of T(1/2 ) 

Solution: 

From (13.1), 

T(n) = [ x n-1 e -x dx (13.24) 

J o 

Then, 

rf|) = f x°' 5_1 e _x dx = f x _0 ' 5 e _x dx (13.25) 

V2y J o J o 
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Letting 
we obtain 


P = 2y 

dy 


dx = 2ydy 

By substitution of the last three relations into (13.25), we obtain 

r(±) = f y 2( “ 0 ' 5) e“ y2 2ydy = 2f y'ye^dy = e^dy 
Next, we define A( 1/2 ) as a function of both x and y, that is, we let 

r(I) = 2jVdx 

r (l) - 2 J/ Vd >' 

Multiplication of (13.27) by (13.28) yields 

Mi)] = 4f e _x dxf e _y dy = 4[ [ e _(x +y ^xdy 
L v 2 /J J Q J 0 J o J 0 

Now, we convert (13.29) to polar coordinates by making the substitution 

2 2 2 

p = x +y 

and by recalling that: 

1. the total area of a region is found by either one of the double integrals 


2. from differential calculus 


A = JJdxdy = JJrdrdG 


d u u d 2 „ u 

—e = e —u = 2ue 
du du 


f P2 -p 2 j 1 ~P 2 
J pe dp = --e 


We observe that as x - 


and y - 


(13.26) 

(13.27) 

(13.28) 

(13.29) 

(13.30) 

(13.31) 

(13.32) 

(13.33) 
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p —» °° and 0—>7i/2 (13.34) 

Substitution of (13.30), (13.33) and (13.34) into (13.29) yields 

r / i \-i2 . n/2 / 2 1°° \ „Jt/2 „n/2 

[ r (D] =- 2 I 0 («n.> = - 4 0 0- 1 )de = 2j o de = 2e | 0 = * 

and thus, we have obtained the exact value 



(13.35) 


Example 13.4 

Compute: 

Solution: 

Using the relations 

we obtain: 

a. for n = -0.5 , 

b. for n = -1.5 , 

c. for n = -2.5 , 


a. r(-0.5) b X (-1.5) c. F (-2.5) 
T(n) = F(n+ ^ and T(0.5) = Jn 


T(-0.5) = = JjL = -2jn 

v ' -0.5 -0.5 


r( -i 5) = r( ~h 5 + U = r(45) = -JM = 4^ 
' 7 -1.5 -1.5 -1.5 3 


r (-2.5) = r <-2.5 + p = ri=L5) = if = Jl& 

y -2.5 -2.5 -2.5 15 

Other interesting relations involving the T(n) function are: 


2 2n -T(n)r(n + I j = JnT(2x\) 
for any n ^ negative integer 


(13.36) 


(13.37) 
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r(n+ 1) = n! 



1, 1 139 571 , 1 

12n 288n 2 51840n 3 2488320n 4 j 


(13.38) 


Relation (13.38) is referred to as Stirling’s asymptotic series for the T(n) function. If n is a positive 
integer, the factorial n! can be approximated as 


n! = Jlnnn’e n 


(13.39) 


Example 13.5 

Use (13.36) to prove that 


Proof: 


or 


Therefore, 


r G) r M) = r (D r G) = A; 

sin- 

2 

(!)]*■« 


r(i) - Jn 


Example 13.6 
Compute the product 


Solution: 

Using (13.36), we obtain 


or 


( 1 ) 




n 
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f n (2} = n = 2n = 

^ ^ S/2 73 3 


Example 13.7 
Use (13.37) to find 

71 ) 

Solution: 

23 '‘ r (l) r (H) = ^ r H) 

2 2 r(!) r (2) = ^r(3) 

r (l) = JnT(3) = 2\Jn = S 
V2 ) 4r(2) 4-1 2 


Example 13.8 

Use (13.39) to compute 50! 

Solution: 


We use MATLAB as a calculator, that is, we type and execute the expression 

sqrt(2*pi*50)*50 A 50*exp(-50) 
ans = 

3.0363e+064 

This is an approximation. To find the exact value, we use the relation T(n+ 1) = n! and the 
MATLAB gamma(n) function. Then, 

gamma(50+1) 

ans = 

3.0414e+064 

We can check this answer with the Excel FACT(n) function, that is, 

=FACT(50) and Excel displays 3.04141 E+64 
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The T(n) function is very useful in integrating some improper integrals. Some examples follow. 


Example 13.9 

Using the definition of the T(n) function, evaluate the integrals 


Solution: 

By definition, 

Then, 


a. f x 4 e X dx b. f x 5 e 2x dx 

J o J o 


f x n l e X dx = T(n) 

J o 


b. 

Let 2x = y; then, dx 


f x 4 e X dx = T(5) = 4! 

J o 

dy/2, and by substitution, 


24 


f x 5 e 2x dx = f 

•'n •'n 


-ydy _ J_r° 
2 


y e y dy 


T(6) = 5! = 120 = U 
64 64 64 8 


Example 13.10 

A negatively charged particle is a meters apart from the positively charged side of an electric 
field. It is initially at rest, and then moves towards the positively charged side with a force 
inversely proportional to its distance from it. Assuming that the particle moves towards the cen¬ 
ter of the positively charged side, considered to be the center of attraction 0, derive an expres¬ 
sion for the time required the negatively charged particle to reach 0 in terms of the distance a 
and its mass m. 

Solution: 

Let the center of attraction 0 be the point zero on the x-axis, as indicated in Figure 13.3. 
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movement of particle 

0 —|-- x 

a 

Figure 13.3. Sketch for Example 13.10 


By Newton’s law, 


m— = -- 
dt 2 x 


(13.40) 


where 

m = mass of particle 
x = distance (varies with time) 

k = positive constant of proportionality and the minus (-) sign indicates that the distance x 
decreases as time t increases. 

At t = 0, the particle is assumed to be located on the x -axis at point x = a, and moves towards 
the origin at x = 0. Let the velocity of the particle be v. Then, 


dx 

dt 


v 


and 

dx^ dv _ dvdx 
dt 2 dt dx dt 

Substitution of (13.42) into (13.40) yields 


dv 

V dx 


or 


k 

x 


mvdv = -“(dx) 


Integrating both sides of (13.44), we obtain 


mv 

~1T 


-klnx + C 


(13.41) 

(13.42) 

(13.43) 

(13.44) 

(13.45) 


where C represents the constants of integration of both sides, and it is evaluated from the initial 
condition that v = 0 when x = a. Then, 
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C = kina 

and by substitution into (13.45), 

= klna-klnx = kln- 
2 x 

Solving for v 2 and taking the square root of both sides we obtain 



Since x decreases as t increases, we choose the negative sign, that is, 



Solving (13.49) for dt we obtain 

dt = - /°L - dx 

A/2k^l n ( a / x ) 


(13.46) 

(13.47) 

(13.48) 

(13.49) 

(13.50) 


We are interested in the time required for the particle to reach the origin 0. We denote this 
time as T; it is found from the relation below, noting that the integration on the right side is 
with respect to the distance x where at t = 0, x = a, and at x = t, x = 0. Then, 


To simplify (13.51), we let 

or 

Also, since 


- f’dx - _ /Af°, dx 

J 0 A /2kJ (X ^/l n (a/x) 

(13.51) 

y = lnf-Y then e y = - 

(13.52) 

Vx7 x 

= ae y , and dx = -ae y dy 

(13.53) 


lim ln^-j = 0 and lim ln(~) = 00 

the lower and upper limits of integration in (13.51), are being replaced with 0 and °° respec¬ 
tively. Therefore, we express (13.51) as 
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m f -ae 




Finally, using the definition of the T(n) function, we obtain 



T ■ ar (i)M 

= aji, M = a M 

(13.54) 

Example 13.11 
Evaluate the integrals 

r n/2 n 

cos ede 

J o 

r n/2 n 

and sin 0d0 

(13.55) 

Solution: 




From the definition of the T(n) function, 




F(n) = J 

|* x n X dx 

(13.56) 

Also, 

F(m) = 

f x m-1 e _x dx 

(13.57) 


For m > 0 and n > 0, multiplication of (13.56) by (13.57) yields 
T(m)r(n) = f u m_1 e _u du[ v n_1 e _v dv 


(13.58) 


where u and v are dummy variables of integration. Next, letting u = x 2 and v = y 2 , we obtain 
du = 2xdx and dv = 2ydy. Then, with these substitutions, relation (13.58) it written as 


r(m)T(n) = f x 2 2xe x dxf y 2 2ye y dy = 4f x 2m 2 xe x dxf y 2n 2 ye y dy 

J o J o J o J o 

.r“r" 2m- 1 2n- 1 -(x 2 + y 2 ), , 

= 4 x y e dxdy 

J o J o 

Next, we convert (13.59) to polar coordinates by letting x = pcos0 and y = psinG Then, 


(13.59) 
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r(m)r(n) = 4[ f (pcos0) 2m ^psinG) 2 " 'e p pdpdG 

J o J o 

n f K/2 2m-1_ . 2n-l_ 2m + 2n-2 -p 2 , 

= 2 cos G • sm GdG p e 2pdp 

J o J o 

To simplify (13.60), we let p 2 = w; then, dw= 2pdp and thus relation (13.60) is written as 

r(m)T(n) = 2l" cos 2m_1 0 • sin 2n_1 GdG[ w m + n_1 e W dw 

J o J o 

= 2f cos 2m_X G • sin 2n_! GdG • T(m + n) 

J 0 

Rearranging (13.61) we obtain 


(13.60) 


(13.61) 


f ^ cos 2m -^ • sin 2 ” - ^dG = r ( m ) r ( n ) 

J n 2T(m + n) 


(13.62) 


and this expression can be simplified by replacing 2m- 1 with n, that is, m = ^,and 
2n - 1 with 0, that is, n = -. Then, we obtain the special case of (13.62) as 


r n/2 n 
J cos 0d0 = 


2r{!^i + ;) r( = .i ) 2 


(13.63) 


If, in (13.62), we replace 2m- 1 with 0 and 2n- 1 with m, we obtain the integral of the sin n 0 
function as 


2r (l 2 + B±l) r (f + 0 2 


(13.64) 


We observe that (13.63) and (13.64) are equal since m and n can be interchanged. Therefore, 


2 2 Jn 


f cos n 0d0 = f sin n 0d0 = —-n>-l 


(13.65) 
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The relations of (13.65) are known as Wallis’s formulas. 


13.2 The Gamma Distribution 

One of the most common probability distributions is the gamma distribution which is defined as 
n- 1 -x/(3 

f(x, n, P) = ---- x>0, n, P>0 (13.66) 

P n F(n) 

A detailed discussion of this probability distribution is beyond the scope of this book; it will suffice 
to say that it is used in reliability and queuing theory. When n is a positive integer, it is referred to 
as Erlang distribution. Figure 13.4 shows the probability density function (pdf) of the gamma distri¬ 
bution for n = 3 and (3 = 2. 


X n p r(n) P A n 
0.0 3.0 2.0 2.0 8.0 

0.2 
0.4 
0.6 
0.8 
1.0 
1.2 

1.4 
1.6 
1.8 
2.0 
2.2 

2.4 


f(x) 

0.0000 

0.0023 

0.0082 

0.0167 

0.0268 

0.0379 

0.0494 

0.0608 

0.0719 

0.0823 

0.0920 

0.1007 

0.1084 


Probability Density Function 
of the gamma distribution 
for n = 3 and P = 2 

0.20 j 

0.15 

S 0.10 

0.05 
0.00 ■ 

0 

X 



2 4 6 8 10 12 


Figure 13.4. The pdf for the gamma distribution. 


We can evaluate the gamma distribution with the Excel GAMMADIST function whose syntax is 

GAMMADIST(x,alpha,beta,cumulative) 

where: 

x = value at which the distribution is to be evaluated 
alpha = the parameter n in (13.66) 
beta = the parameter p in (13.66) 


* Several probability distributions are presented in Mathematics for Business, Science, and Technology, ISBN 0-9709511- 
0 - 8 . 
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cumulative = a TRUE / FALSE logical value; if TRUE, GAMMADIST returns the cumulative 
distribution function (cdf), and if FALSE, it returns the probability density function (pdf). 

Example 13.12 

Use Excel’s GAMMADIST function to evaluate f(x), that is, the pdf of the gamma distribution if: 

a. x = 4, n = 3, and P = 2 

b. x = 7, n = 3, and P = 2 

Solution: 

Since we are interested in the probability density function (pdf) values, we specify the FALSE 
condition. Then, 

a. 

=GAMMADIST(4,3,2,FALSE) returns 0.1353 

b. 

=GAMMADIST(7,3,2,FALSE) returns 0.0925 
We observe that these values are consistent with the plot of Figure 13.4. 

13.3 The Beta Function 

The beta function, denoted as B(m, n), is defined as 

B(m, n) = f x m_1 (l-x) n_1 dx (13.67) 

J o 

where m > 0 and n > 0 . 


Example 13.13 
Prove that 

| B(m, n) = B(n,m)| (13.68) 

Proof: 

Let x = 1 — y; then, dx = -dy. We observe that as x —> 0, y —> 1 and as x —> 1, y —> 0. There¬ 
fore, 

* Several probability density functions are also presented on the text mentioned on the footnote of the previous page. 
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B(m, n) = [ 1 x m " 1 (l-x) n - 1 dx = -fV - y) m_ '[1 - (1 - y)] n ~ ! dy 

J o J i 

= f (i-y) m_1 y n_1 dy = f y n_1 (i-y) m_1 dy = B(n,m) 

J o J o 

and thus (13.68) is proved. 

Example 13.14 

Prove that 

B(m, n) = cos 2m_ *0 • sin 2n_ ! 0d0 (13.69) 

J o 

Proof: 

We let x = sin 2 0; then, dx = 2sin0cos0d0. We observe that as x—>0, 0 —»0 and as x—» 1, 
0 —> n/2 . Then, 

B(m, n) = f x m_1 (l-x) n-1 dx 

J o 

= 2[ (sin 2 0) m 1 (cos 2 0) n-1 sin0cos0d0 (13.70) 

J o 

= 2[ (sin 2m_1 0)(cos 2m_1 0)d0 

J o 


Example 13.15 
Prove that 


B(m, n) 


T(m)r(n) 
r(m + n) 


Proof: 

The proof is evident from (13.62) and (13.70). 


(13.71) 


The B(m, n) function is also useful in evaluating certain integrals as illustrated by the following 
examples. 
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Example 13.16 
Evaluate the integral 


Solution: 

By definition 


and thus for this example, 


Using (13.71) we obtain 


f x 4 (l -x) 3 dx 

J o 


B(m, n) = [ x m 1 (1 — x) n *dx 

J o 

f x 4 (l-x) 3 dx = B(5, 4) 


Bf5 4) = r ( 5 ) r ( 4 ) = 1111 - 24x6 = J44_ = J_ 
F(9) 8! 40320 40320 280 

We can also use MATLAB’s beta(m,n) function. For this example, 

format rat; % display answer in rational format 
z=beta(5,4) 

z = 

1/280 


(13.72) 


(13.73) 


Excel does not have a function that computes the B(m, n) function directly. However, we can 
use (13.71) for its computation as shown in Figure 13.5. 

r(m) r(n) r(m+n) Beta(m,n)= 

exp(gammaln(m)) exp(gammaln(n)) exp(gammaln(m+n)) r(m) x r(n) / r(m+n) 

m= 5 

24.00 6.00 40320.00 1/280 


Figure 13.5. Computation of the beta function with Excel. 


Example 13.17 
Evaluate the integral 

f^=dx (13.74) 

J o j2-x 
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Solution: 

Let x = 2v; then x 2 = 4v 2 , and dx = 2dv. We observe that as x —> 0, v —> 0, and as x —> 2, 
v —> 1. Then, (13.74) becomes 


f -^=2dv = -U -2=dv = 4,/2f v 2 (l-v)"‘ 
J o J2 - 2v 72 J 0 Jl-v J o 


(13.75) 


where 


F(3) = 2! 

r(1/2) = VS 

r ( 7/2 ) = (7/2 - 1)F (7/2 - 1) = (5/2) T( 5/2 ) = (5/2)(5/2 — 1)F( 5/2 - 1) 
= 5/2 • 3/2 • (3/2 - l)r ( 3/2 - 1) = (15/8)F ( 1/2 ) = 15^/8 
Then, from (13.74), (13.75) and (13.76) we obtain 


(13.76) 


r 2 X 2 d; , = 4V2 • 2\ • Jn = 64V2 
0 */2--x 15VS /8 15 


(13.77) 


13.4 The Beta Distribution 

The beta distribution is defined as 


m- 1 .. , 1 - 1 

f(x, m, n) = --LLliLl- x<0< 1, m,n>0 (13.78) 

B(m, n) 

A plot of the beta probability density function (pdf) for m = 3 and n = 2, is shown in Figure 
13.6. 

As with the gamma probability distribution, a detailed discussion of the beta probability distribu¬ 
tion is beyond the scope of this book; it will suffice to say that it is used in computing variations in 
percentages of samples such as the percentage of the time in a day people spent at work, driving 
habits, eating times and places, etc. 

Using (13.71) we can express the beta distribution as 

f(x, m, n) = T ^ m ~ f ~ n ) • x m ~*(1 -x) n 1 x<0<1, m,n>0 (13.79) 

r(m)T(n) 
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0.00 

0.02 

0.04 

0.06 

0.08 

0.10 

0.12 

0.14 

0.16 

0.18 

0.20 

0.22 

0.24 

0.26 

0.28 

0.30 

0.32 

0.34 


m n r(m) r(n) r(m+n) x (m ' 1) (1-x) (n ' 1) f(x,m,n) 

3.0 2.0 2.0 1.0 24.0 0.0000 1.0000 0.0000 

0.0047 
0.0184 
0.0406 
0.0707 
0.1080 
0.1521 
0.2023 
0.2580 
0.3188 
0.3840 
0.4530 
0.5253 
0.6003 
0.6774 
0.7560 
0.8356 
0.9156 


0.0004 0.9800 

Probability Density Function 
of the Beta Distribution 
for m = 3 and n = 2 



0.0 0.2 0.4 0.6 0.8 1.0 


X 


0.1156 0.6600 


Figure 13.6. The pdf of the beta distribution 


We can evaluate the beta cumulative distribution function (cdf) with Excels’s BETADIST func¬ 
tion whose syntax is 

BETADIST(x, alpha,beta, A,B) 

where: 

x = value between A and B at which the distribution is to be evaluated 
alpha = the parameter m in (13.79) 
beta = the parameter n in (13.79) 

A = the lower bound to the interval of x 
B = the upper bound to the interval of x 

From the plot of Figure 13.6, we see that when x = 1, f(x, m, n) which represents the probabil¬ 
ity density function, is zero. However, the cumulative distribution (the area under the curve) at 
this point is 100% or unity since this is the upper limit of the x-range. This value can be verified 
by 

=BETADIST(1,3,2,0,1) which returns 1.0000 
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13.5 Summary 

• The gamma function, denoted as T(n), is also known as generalized factorial function. It is 
defined as 


T(n) =| x n *e 


dx 


' It is convenient to use the relation 


for n < 0 and the relation 


T(n) = T(n + 1) 
n 

nT(n) = T(n+ 1) 


for n > 0. 

* The T(n) function is defined for all positive integers and positive fractional values, and for all 
negative fractional, but not negative integer values. 

* The T(n) function and the factorial n! are related as 

T(n+ 1) = n! for n = 1,2,3, ... 

* We can use MATLAB’s gamma(n) function to obtain values of T(n). 

* We can use the EXP(GAMMALN(n)) function to evaluate T(n) at some positive value of n. 

* To evaluate T(n) when n is a positive integer, we can use the relation 

F(n) - (n- 1)! 

* Other useful relations are shown below. 

T (1/2 ) = Jn 

T(n)r(l-n) = ^C_ 

sinn7t 

for 0<n<l 


2 2n Vfn)^ = JnT{2n) 
for any n + negative integer 


’ The relation 


T(n + 1) = n! = J2nm\ n e “•! 1 + —+ —-—- - - 
l 12n 288n 5 


139 


571 


■■■) 


51840n 2488320n 

is referred to as Stirling’s asymptotic series for the T(n) function. If n is a positive integer, the 
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factorial n! can be approximated as 

n! = V2ttnn n c _n 

• The T(n) function is very useful in integrating some improper integrals. 

• The relations 

T/n+n 


J cos n 0d0 = | sin n 0d0 = 


2 ' Jn 


AT n > -1 


are known as Wallis’s formulas. 

• The gamma distribution which is defined as 


f(x, n, P) = 


x> 0, n, P > 0 


p n T(n) 

' The beta function, B(m, n) where m > 0 and n > 0 is defined as 


B(m, n) = [ x m 1 (1 — x) n 

^ n 


• The beta function B(m, n) and gamma function T(n) are related by 

.B(m, n) = r(m)F(n) 

T(m + n) 

• The beta B(m, n) function is also useful in evaluating certain integrals. 

• We can use MATLAB’s beta(m,n) function to evaluate the beta B(m, n) function. 

• The beta distribution is defined as 


f(x, m, n) = - 


(1 -x) 


B(m, n) 


x< 0<1, m, n>0 
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13.6 Exercises 

1. Given that m = 2.5 and n = -1.25, compute 

r(m + n) 

F(m)r(n) 

Verify your answer with MATLAB and Excel 

2. Given that m = 10 and n = 8 , compute B(m, n) 

Verify your answer with MATLAB and Excel 

3. Evaluate the following integrals 

a. f e -x dx 

J o 


b. [ xe x dx 

J o 
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13.7 Solutions to End-of-Chapter Exercises 
1 . 

By repeated use of the relations nr(n) = T(n+ 1) for n> 1 and T(n) = ^( n + D for n< 1, 

n 

we obtain 

r(m + n) = r(2.5 + (-1.25)) = T(1.25) = T( 5/4) 

r(m)r(n) r(2.5)r(-1.25) r(2.5)r(-1.25) r(5/2)-r(-5/4) 

_ r(i/4+1) = _ i/4-r(i/4) _ 

r(3/2 I 1) r( ~ 5 3^ 1} 3/2 ■ r (3/2) ■ (-4/5) • T(-l/4) (1) 

= _ i/4-r(i/4) _ = 5 r(i/4) 

3/2 • 1/2 • T(l/2) • (-4/5) • 48 ^' r(3/4) 


There are no exact values for T( 1/4) and T(3/4); therefore, we obtain their approximate 
values from tables, where we find that T(l/4) = 3.6256 and T(3/4) = 1.2254. Then, by 
substitution into (1) we obtain: 


T(m + n) = _5_ 3.6256 

r(m)T(n) 48 ' ^ . L2 254 


= 0.1739 


Check with MATLAB: 

m=2.5; n=-1.25; gamma(m+n)/(gamma(m)*gamma(n)) 


ans = 

0.1739 

We cannot check the answer with Excel because it cannot compute negative values. 


B(m n) = r ( m ) r W = r ( 1Q )' r ( 8 ) = ( 9! )x( 7! ) 

V ' T(m + n) T( 18) 17! 

9-8-7-6-5-4-3-2-7-6-5-4-3-2 
17 • 16 • 15 ■ 14 ■ 13 • 12 • 11 • 10 • 9 • 8 • 7 • 6 • 5 • 4 ■ 3 • 2 

_ _ 7 • 6 • 5 • 4 • 3 • 2 _ 5040 _ ^ J419 x 10 -6 

17-16-15 • 14 • 13 • 12-11 • 10 980179200 


Check with MATLAB: 

beta(10,8) 

ans = 

5.1419e-006 
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3. 


t , 3 , 1/3 , 1 (-2/3) j 

Let x = y, then x = y , dx = - • y dy, so 


G Vdx = G' y i yl/3 "‘ dy = K n 


f xe x dx = [ x 2 'e X dx = T(2) = 1! = 1 

•'n •'n 


We let x 4 = y orx = y 1/4 . Then, dx = (l/4)y^ 3/4) dy and thus 

f 1 ^ = Ij^.y^dy = ifV-y^.y^dy 
J ° J^ZZ 4 4J oVTy 4J 0 

= - f 1 (1 — y) 1/2 ~ 1 • y 1/4 ~ 1 dy = 1. r(1/4) ~ r(1/2) 
4J/ y> y y 4 T(3/4) 


( 1 ) 


Also, 


T(3/4) • T(1 - 3/4) = - 


sin(37t/4) ^2/2 


r(3/4)-r(l/4) = J2n, T(3/4) = 0^ 


and by substitution into (1) 


r 1 dx = 1 T(l/4)-r(l/2) = 1 T( 1/4) • Jn 
Kj{Z? ~ 4 r(3/4) 4 " j2n/T(l/4) 

= ^. {r(1/4)1 ^{Ul/4)} 2 

47271 4j2n 


[ n/2 VtanOdG = f^Y^iy^de = [ 71/2 (sin0) 1/2 (cos0)” I/2 (d0) 
J n VCOS0/ 


From (13.62), 


cos 0 • sin 


2n_1 ede = HHins) 

2T(m + n) 
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Letting 2m- 1 = 1/2 and 2n- 1 = -1/2 we obtain m = 3/4 and n = 1/4 .Then, 

RWede = r < 3/4 > r < 1/4 > = 

J„ 2T(3/4 +1/4) 2r(l) 2 


rl 


dx 


o Jx(3 -x) 


-1. 


Let X = 3y, then dx = 3dy, x 1/2 = (3y) 1/2 = (73/3)y 1/2 . When x = 0, y = 0 and 
when x = 3 , y = 1, and the integral of (1) becomes 


73 -f 1 -1/2 - .-1/2 , cf 1 -1/2 1 n _1/2 , 

t- 3 y • (3 - 3y) dy = 73 y ■—(1-y) dy 
J 0 0 (2) 
f 1 “1/2,, X- 1/2 J 

= y (i-y) dy 

J o 

Recalling that 

B(m, n) = jV-'a-xf^dx = ' r( ° } 

J o F(m + n) 

it follows that m - 1 = -1/2, m = 1/2, n - 1 = -1/2, m = 1/2 and thus 
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Orthogonal Functions and Matrix Factorizations 


Chapter 14 


T his chapter is an introduction to orthogonal functions. We begin with orthogonal lines and 
functions, orthogonal trajectories, orthogonal vectors, and we conclude with the factoriza¬ 
tion methods LU, Cholesky, QR, and Singular Value Decomposition. 

14.1 Orthogonal Functions 

Orthogonal functions are those which are perpendicular to each other. Mutually orthogonal sys¬ 
tems of curves and vectors are of particular importance in physical problems. From analytic geom¬ 
etry and elementary calculus we know that two lines are orthogonal if the product of their slopes is 
equal to minus one. This is shown in Figure 14.1. 



Figure 14-1. Orthogonal lines 


Orthogonality applies also to curves. Figure 14.2 shows the angle between two curves C, and C 2 



Figure 14-2. Orthogonal curves 
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Chapter 14 Orthogonal Functions and Matrix Factorizations 

By definition, in Figure 14.2, the angle between the curves Cj and C 2 is the angle P between 
their tangent lines L, and L 2 . If rtij and m 2 are the slopes of these two lines, then, L } and L 2 
are orthogonal if m 2 = -1 /m,. 


Example 14.1 

Prove that every curve of the family 


xy = a a ± 0 (14.1) 

is orthogonal to every curve of the family 

x 2 -y 2 = b b * 0 (14.2) 


Proof: 

At a point P(x, y) on any curve of (14.1), the slope is 

xdy + ydx = 0 


or 


dy = _Y 

dx x 

On any curve of (14,2) the slope is 

2xdx-2ydy = 0 


or 


(14.3) 


dy = 5 (14.4) 

dx y 

From (14.3) and (14-4) we see that these two curves are orthogonal since their slopes are negative 
reciprocals of each other. The cases where x = 0 or y = 0 cannot occur because we defined 
a * 0 and b * 0. 

Other orthogonal functions are the cosx and sinx functions as we’ve learned in Chapter 6. 


14.2 Orthogonal Trajectories 

Two families of curves with the property that each member of either family cuts every member of 
the other family at right angles are said to be orthogonal trajectories of each other. Thus, the curves 
of (14.2) are orthogonal trajectories of the curves of (14.1). The two families of these curves are 
shown in Figure 14.3. 
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Figure 14-3. Orthogonal trajectories 


Example 14.2 

Find the orthogonal trajectories of the family of parabolas 


Solution: 

The slope of (14.5) is 


y = cx c^O 


!|Z = 2cx 
dx 


From (14.5), c = y/x and thus we rewrite (14.6) as 

& = 2^x = 
dx x 2 x 

Therefore, the slope of the orthogonal family we are seeking must be 

dy x_ 

dx 2y 

or 

2ydy + xdx = 0 
2jydy + Jxdx = 0 

2 2 

2 y + |- = k (constant) 


(14.5) 


(14.6) 


(14.7) 


(14.8) 


(14.9) 
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Relation (14.9) represents a family of ellipses and the trajectories are shown in Figure 14-4- 



Figure 14-4. Orthogonal trajectories for families of parabolas and ellipses. 


14.3 Orthogonal Vectors 

Let X = [xj x 2 x 3 ... x n ] and Y = [y j y 2 y 3 ... y n ] be two vectors of the same length. Their 
inner (dot) product is defined as 

X-Y = x x yj + x 2 y 2 + x 3 y 3 + ... + x n y n (a scalar) (14.10) 


Example 14.3 

Given that 

X = [1 1 1] and Y = [2 1 2] 

find the dot product X • Y 


Solution: 


X-Y = (l)-(2) + (l)-(l) + (l)-(2) = 5 


Definition:Two vectors X, and X 2 are said to be orthogonal if their dot product is zero. 


Example 14.4 

Test the vectors 

Xj = [1 1 1] and X 2 = [1 -2 1] 

for orthogonality. 
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Solution: 


Orthogonal Vectors 


X r X 2 = (1).(!) + (!).(_2) + (l).(l) = 0 
Therefore, the vectors Xj and X 2 are orthogonal to each other. 


With any vector X ^ 0 we may associate a unique unit vector U which is obtained by dividing 
each component of X by each magnitude |X| defined as 

|X| = + x 2 + ... + 

where Xj represents an element of the vector X. This process is called normalization. 


Example 14.5 
Given that 

X = [2 4 4] 

compute the unit vector U x . 

Solution: 

First, we compute the magnitude |X| . For this example, 

|X| = J2 2 + 4 2 + 4 2 = 6 

To compute the unit vector U x we divide each element of X by the magnitude |X| . Thus, 


i i ti 

l_6 6 6j 


[1 1 I] 


A basis that consists of mutually orthogonal vectors is referred to as an orthogonal basis. If these 
vectors are also unit vectors, the basis is called orthonormal basis. 

If the column (or row) vectors of a square matrix A are mutually orthogonal unit vectors, the 
matrix A is orthogonal and 


A-A = I 

where A T is the transpose of A and I is the identity matrix. 


(14.11) 
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Example 14.6 
Given that 

A = [ 1/2 1/4 j 

|_l/2 1/2J 

find an orthonormal set of eigenvectors and verify that the result satisfies (14.11). 

Solution: 

First, we find the eigenvalues of the matrix A from the relation det(A - XI) = 0 where for this 
example 

1/2 1/4 I-J 1 °|] =0 
1/2 1/2 | | 0 1 \ ) 

1/2 - X 1/4 I = Q 
1/2 1/2 - X | 

X 2 -X + 3/16 = 0 



from which X x = 1/4 and X 2 = 3/4 and as we’ve learned in Chapter 5, with these eigenvalues 
we can obtain an infinite number of eigenvectors. To find a 2 x 2 square matrix Z such that 


we begin with 


:: 


(14.12) 


-z\ + z 2 
2 2 

Z, + Z , 


Equating like terms we obtain 


(14.13) 


From the second equation we obtain z 2 = z 2 and by substitution into the first we obtain 2z 2 = 1 
or 


* It is strongly suggested that the reader reviews the definitions of eigenvalues and eigenvectors in Chapter 5 at this time. 
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Zj = z 2 = 

This result indicates that we can choose either \/ Ji or \/{-j2) for the values of Zj and 
z 2 .We choose the value \/ Jl and then the first (left most) matrix in (14.12) is 

z = 1/72 1/72 

l/(-72) 1/72 

and as a check, 

1/72 1/72 

_l/(-72) 1/72 


1/72 l/(-72) = |~1 oj 
1/72 1/72 _ L° l 


The computations for finding orthonormal sets of eigenvectors for larger size (3x3 or higher) 
matrices using the above procedure becomes quite involved. A simpler procedure is the Gram- 
Schmidt orthogonalization procedure which is discussed on the next section. 


14.4 The Gram-Schmidt Orthogonalization Procedure 

Let Xj, X 2 , ...X m be some column vectors. We can find an orthogonal basis Yj, Y 2 , ...Y m using 
the following relations. We must remember that the products in (14.14) below are the inner 
(dot) products and if X = [xj x 2 x 3 ... x n ] and Y = [y 1 y 2 y 3 ... y n ] are two vectors of the 
same length their dot product is defined as X • Y = Xj y x + x 2 y 2 + x 3 y 3 + ... + x n y n (a scalar). 
Thus in the second equation in (14.14) the dot products on the numerator and denominator must 
be found first and the result must be from the dot product of it and Y, 


Y, = X, 


y 2 

y 3 


= X 3 - 


Yi-X 2 

YpYj 

y 2 -x 3 

y 2 -y 2 


Yi 

Y 2 


Yi'X 3 

YfYj 


Yj 


(14.14) 



Also, the unit vectors 


Yj ' X m 
Y,-Y x 


Y! 
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Uj = j^ij i = 1,2, m (14.15) 

are mutually orthogonal and form an orthonormal basis. 

In our subsequent discussion the column vectors will be denoted as row vectors transposed. 


Example 14.7 

Given that Xj = [1 1 l] T ,X 2 = [l-2 l] T ,andX 3 = [12 3] T ,find an orthonormal basis. 
Solution: 

From (14.14) 


Y l 

y 2 

Y 3 


X, = I 1 1 l] 1 
„ Y.-X, 


= [1 -2 l ] 1 


3 Y 2 -Y 2 2 V, . 

[1 2 3] T - [2 2 2] T = [-1 0 1] T 


and from (14.15) 


Ui = = [1/73 1/73 l/v^] T 

l Y i| 

u 2 = = [1/76 -2/76 1/76] T 

l Y 2| 

u 3 = = [-1/72 0 i/72] t 

l Y 3| 

and denoting the matrix whose elements are the unit vectors as A, we have: 


1/73 

i/75 

1/73 


1/76 -1/72 
-2/76 0 

1/76 1/72 


We can verify that A • A T = I with the MATLAB script below. 

A=[1/sqrt(3) 1/sqrt(6) -1/sqrt(2); 1/sqrt(3) -2/sqrt(6) 0; 1/sqrt(3) 1/sqrt(6) 1/sqrt(2)]; 
|=A*A' 
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1.0000 

0 

0.0000 

0 

1.0000 

0 

0.0000 

0 

1.0000 


We can also use the MATLAB function orth(A) to produce an orthonormal basis as shown 
below. 

B=[1 1 1; 1 -2 1; 1 2 3]; C=orth(B) 

C - 

-0.4027 0.0000 0.9153 

0.0000 1.0000 0.0000 

-0.9153 0.0000 -0.4027 

We observe that the vectors of the C matrix produced by MATLAB are different from those we 
derived with the Gram-Schmidt orthogonalization procedure. The reason for this difference is 
that the orthogonalization process is not unique, that is, we may find different values depending 
on the process being used. As shown below, the vectors produced by MATLAB also satisfy the 


condition C • C T = 

l=C*C' 

I. 


I = 

1.0000 

- 0.0000 

0.0000 

- 0.0000 

1.0000 

- 0.0000 

0.0000 

- 0.0000 

1.0000 


14.5 The LU Factorization 

In matrix computations, computers use the so-called matrix factorization methods to decompose 
a matrix A into a product of other smaller matrices. The LU factorization method decomposes a 
matrix A into a lower triangular matrix L and an upper triangular matrix U so that A = L • U. 
In Chapter 4 we saw how the method of Gaussian elimination proceeds by systematically remov¬ 
ing the unknowns from a system of linear equations. 

Consider the following 3x3 lower triangular case. 


L n 0 

0 


X 1 


bi 

L 2 i L 22 

0 


x 2 

II 

b 2 

L 31 L 32 

L 33_ 


X 3_ 


b 3 


The unknowns are found from 
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Xj = bj/Ljj 

x 2 = (b 2 -L 2lXl )/L 22 (14.16) 

x 3 = ( b 3 - L 31 Xj -L 31 x 2 )/L 3 3 

provided that L n • L 22 • L 33 ± 0. The substitution order in (14.16) is referred to as forward substi¬ 
tution. 

For the upper triangular case, the unknowns are written in reverse order. Thus, to solve 


U„ 

u 12 u 13 


X 1 


b i 

0 

u 22 u 23 


X 2 

= 

b 2 

0 

0 U 33 


x 3 


b 3 


we start from the bottom to the top as shown below. 

x 3 = b 3 /U 33 

x 2 = (b 2 -U 23 x 3 )/U 22 

x i = (bj-U 12 x 2 -U 13 x 3 )/Uy 


(14.17) 


(14.18) 


provided that U n • U 22 • U 33 + 0. The substitution order in (14.18) is referred to as backward sub¬ 
stitution. 


Example 14.8 

Let us review the example given in Chapter 4 which consists of the following equations. 

2vj - v 2 + 3 v 3 = 5 

-4vj - 3 v 2 -2v 3 = 8 (14.19) 

3v 1 + v 2 -v 3 = 4 

To find the three unknowns, we begin by multiplying the first equation by -2 and subtracting it 
from the second equation. This removes v, from the second equation. Likewise, we multiply the 
first equation by 3/2 and we subtract it from the third equation. With these two reductions we 
obtain 

2 y i - v 2 + 3 v 3 = 5 

-5v 2 + 4v 3 = 18 (14.20) 

2.5v 2 -5.5v 3 = -3.5 
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Next we multiply the second equation of (14.20) by -1/2 and we subtract it from the third 
equation of (14.20) and we obtain the system of equations below. 

2\ l - v 2 + 3 v 3 = 5 

-5v 2 + 4v 3 = 18 (14.21) 

-3.5v 3 = 5.5 

We see that the eliminations have transformed the given square system into an equivalent upper 
triangular system that gives the same solution which is obtained as follows: 

v 3 = -11/7 

v 2 = (18 -4v 3 )/(-5) = -34/7 
Vj = (5 + v 2 - 3v 3 )/2 = 17/7 


The elements of the upper triangular matrix U are the coefficients of the unknowns in (14.21). 
Thus, 


U u 

u 12 u 13 


2-13 

0 

u 22 u 23 

= 

0-5 4 

0 

0 U 33 


0 0 -3.5 


Now, let us use the relations of (14.16) and (14.18) to find the lower and upper triangular matri¬ 
ces of our example where 


2-13 
-4 -3 -2 
3 1-1 


We want to find L ;j and Uy such that 


L n 0 0 

L 2 i L 22 0 


u n u 12 u 13 

0 U 22 U 23 

= A = 

2-13 

-4 -3 -2 

(14.22) 

L 31 L 32 L 33 _ 


o 

O 


_ 3 1 -1_ 



where the first matrix on the left side is the lower triangular matrix L and the second is the 
upper triangular matrix U. The elements of matrix U are the coefficients of v l , v 2 , and v 3 in 
(14.20). To find the elements of matrix L we use MATLAB to multiply matrix A by the inverse 
of matrix U. Thus, 

U=[2 -1 3; 0 -5 4; 0 0 -3.5]; A=[2 -1 3;-4 -3 -2; 3 1 -1]; L=A*inv(U) 
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10 0 
-2 10 
3/2 -1/2 1 

Therefore, the matrix A has been decomposed to a lower triangular matrix L and an upper 
matrix U as shown below. 


2-13 


1 

0 

0 


2 

-1 3 

-4 -3 -2 

= 

-2 

1 

0 


0 

-5 4 

3 1-1 


3/2 

-1/2 

1 


0 

0 -3.5 


Check with MATLAB: 

L=[1 0 0; -2 1 0; 3/2 -1/2 1]; U=[2 -1 3; 0 -5 4; 0 0 -3.5]; A=L*U 

A = 


-1 

-3 

1 


In the example above, we found the elements of the lower triangular matrix L by first computing 
the inverse of the upper triangular matrix U and performing the matrix multiplication 
L = A • U _1 but not L = U _1 • A. Was this necessary? The answer is no. For a square matrix 
where none of the diagonal elements are zero, the lower triangular matrix has the form 

1 0 0 
L = L 21 1 0 

L 31 L 32 1 

and in our example we found that the values of the subdiagonal elements are L 21 = -2, 
L 31 = 3/5 , and L 32 = -1/2. These values are the multipliers that we’ve used in the elimination 
process in succession. 


Example 14.9 

Use the MATLAB function [L,U]=lu(A) to decompose the matrix 


2 -3 1 
-1 5 -2 
3-8 4 
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into a lower and an upper triangular. 

Solution: 

format rat; A=[2 -3 1;-1 5 -2; 3 -8 4]; [L,U]=lu(A) 

L = 

2/3 1 1 

-1/3 1 0 

10 0 

U - 

3-8 4 

0 7/3 -2/3 

0 0-1 

We observe that while the upper triangular matrix U has the proper structure, the lower trian¬ 
gular matrix L lacks structure. When a matrix lacks structure we say that it is permuted. To put 
L in the proper structure, let us interchange the first and third rows. Then, 


1 0 0 
L ' = -1/3 1 0 

2/3 1 1 


(14.23) 


The new matrix L' has now the proper structure. Let us now use MATLAB to see if L' • U = A. 
L1=[1 0 0; -1/3 1 0; 2/3 1 1]; U=[3 -8 4; 0 7/3 -2/3; 0 0 -1];A1=L1*U 
Al = 

3-8 4 

-1 5 -2 

2-3 1 


We observe that matrix A is now permuted. To put it in the given form we need to make the 
same interchanges in rows as with the lower triangular matrix, that is, we must interchange the 
first and third rows. 


To find out how MATLAB performs LU factorization, let us invoke the help lu command. Only 
part of the display is shown below. 

help lu 

LU LU factorization. 

[L,U] = lu(X) stores an upper triangular matrix in U and a 
"psychologically lower triangular matrix" (i.e. a product 
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of lower triangular and permutation matrices) in L, so 
that X = L*U. X can be rectangular. 

[L,U,P] = lu(X) returns unit lower triangular matrix L, upper 
triangular matrix U, and permutation matrix P so that 
P*X = L*U. 

The permutation matrix P is an identity matrix that is permuted so that the rows of this matrix 
indicate the interchanges. Consider, for example, the identity matrix 


1 0 0 


1 = 0 1 0 
0 0 1 


If we interchange the first and third rows of the identity matrix I above, we obtain the permuta¬ 
tion matrix P below. 


0 0 1 


(14.24) 


p = 0 1 0 
1 0 0 


and matrix P indicates the same interchanges as with the lower triangular matrix in Example 


14.9. 


Example 14.10 

Use the MATLAB function [L,U,P]=lu(A) to decompose the matrix 


2 -3 1 
A = -1 5-2 


3-8 4 


into a lower and an upper triangular and show that P • A = L • U. 

Solution: 

This is the same matrix as in Example 14.9. Thus, 

A=[2 -3 1; -1 5 -2; 3 -8 4]; [L,U,P]=lu(A) 


L - 


1 

-1/3 

2/3 


0 

1 

1 


0 

0 

1 
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u = 

3-8 4 

0 7/3 -2/3 

0 0-1 

P = 

0 0 1 

0 10 
10 0 

We observe that the lower triangular matrix has now the proper structure and the P matrix dis¬ 
played by MATLAB is the same as in (14.24). Also, 

PA=P*A, LU=L*U 

PA = 

3-8 4 

-1 5 -2 

2- 3 1 

LU = 

3- 8 4 

-1 5 -2 

2-3 1 

We observe that P • A = L • U with the first and second rows interchanged when compare with 
the given matrix A. 


The MATLAB matrix left division operator x = A\b uses the L • U factorization approach. 

The user-defined function ExchRows below, interchanges rows i and j j of a vector or matrix 
X. 

% The function ExchRows interchanges rows i and j 
% of a matrix or vector X 

% 

function X = ExchRows(X,i,j) 

% 

temp = X(i,:); 

X(i,:) = X(j,:); 

X(j,:) = temp; 

% This file is saved as ExchRows.m 

% To run this program, define the matrix or vector 

% X and the indices i and j in MATLAB's Command Window 

% as X=[_J, i = {first row # to be interchanged}, 

% j = {row # to be interchanged with row i}, and 
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% then type ExchRows(X,i,j)at the command prompt. 


Example 14.11 

Given that the matrix X is defined as 

-2 5-49 
^ _ -3-6 8 1 

7-532 
4-9-8 -1 

use the ExchRows.m user-defined function above to interchange rows 1 and 3. 

Solution: 

At the MATLAB command prompt we enter 

X=[-2 5-4 9;-3 -6 8 1; 7 -5 3 2; 4 -9 -8 -1];i = 1;j = 3; 
ExchRows(X,i,j) 

and MATLAB outputs 
X - 

7-532 
-3-6 8 1 

-2 5-4 9 

4 -9 -8 -1 


The user-defined function GaussElimPivot below, performs Gauss elimination with row pivot¬ 
ing. First, let us explain the use of MATLAB’s built-in function max(v) where v is a row or a col¬ 
umn vector, and for matrices is a row vector containing the maximum element from each column. 
As an example, let 

v=[2 -1 3-5 7-9 -12]'; max(v) 

ans = 

7 

[Amax,m]=max(v) 

Max = 

7 

m = 

5 

[Amax,m]=max(abs(v)) 
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The LU Factorization 


Max = 


12 


m = 

7 

% This user-defined function file solves A*x=b by 
% the Gauss elimination with row pivoting method. 

% A is a matrix that contains the coefficients of 
% the system of equations, x is a column vector that 
% will display the computed unknown values, and b 
% is a column vector that contains the known values 
% on the right hand side. 

function x = GaussElimPivot(A,b) 

if size(b,2) > 1; b=b'; 
end 

n = length(b); z = zeros(n,1); 

% Set up scale factor array 

for i = 1 :n; z(i) = max(abs(A(i,1 :n))); 
end 

% The statements below exchange rows if required 
for k = 1 :n—1 

[Amag,m] = max(abs(A(k:n,k))./z(k:n)); 
m = m + k- 1; 

if Amag < eps; error('Matrix is singular 1 ); 
end 

if m ~= k 

b = ExchRows(b,k,m); 
z = ExchRows(z,k,m); 

A = ExchRows(A,k,m); 
end 

% Elimination steps 

fori= k+1:n 
if A(i,k) ~=0 
alpha = A(i,k)/A(k,k); 

A(i,k+1 :n) = A(i,k+1 :n) - alpha*A(k,k+1 :n) 
b(i) = b(i) - alpha*b(k); 
end 
end 
end 

% Back substitution phase 
for k = n:-1:1 

b(k) = (b(k) - A(k,k+1 :n)*b(k+1 :n))/A(k,k); 
end 
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% Enter the values of A and b at the MATLAB's 
% command window and type GaussElimPivot(A,b), x 


Example 14.12 
Given that 


-2 5-4 9 


-3 


x i 

-3-68 1 

, b = 

2 

, x = 

x 2 

7-532 


8 


x 3 

4-9-8 -1 


5 


X 4 


use the GaussElimPivot user-defined function above to compute the values of the vector x. 

Solution: 

At the MATLAB command prompt we enter 

A=[-2 5 -4 9; -3 -6 8 1; 7 -5 3 2; 4 -9 -8 -1]; b = [-3 2 8 5]'; 
GaussElimPivot(A,b), x 

and MATLAB outputs the following: 

A - 


7.0000 

-5.0000 

3.0000 

2.0000 

-3.0000 

-8.1429 

9.2857 

1.8571 

-2.0000 

5.0000 

-4.0000 

9.0000 

4.0000 

-9.0000 

-8.0000 

- 1.0000 

7.0000 

-5.0000 

3.0000 

2.0000 

-3.0000 

-8.1429 

9.2857 

1.8571 

-2.0000 

3.5714 

-3.1429 

9.5714 

4.0000 

-9.0000 

-8.0000 

- 1.0000 

7.0000 

-5.0000 

3.0000 

2.0000 

-3.0000 

-8.1429 

9.2857 

1.8571 

-2.0000 

3.5714 

-3.1429 

9.5714 

4.0000 

-6.1429 

-9.7143 

-2.1429 

7.0000 

-5.0000 

3.0000 

2.0000 

-3.0000 

-8.1429 

9.2857 

1.8571 

-2.0000 

3.5714 

0.9298 

10.3860 

4.0000 

-6.1429 

-9.7143 

-2.1429 
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A = 


7.0000 

-5.0000 

3.0000 

2.0000 

-3.0000 

-8.1429 

9.2857 

1.8571 

-2.0000 

3.5714 

0.9298 

10.3860 

4.0000 

-6.1429 

-16.7193 

-3.5439 

7.0000 

-5.0000 

3.0000 

2.0000 

-3.0000 

-8.1429 

9.2857 

1.8571 

4.0000 

-6.1429 

-16.7193 

-3.5439 

-2.0000 

3.5714 

0.9298 

10.1889 

0.7451 

-1.0980 

0.1176 

-0.1373 


Check with MATLAB’s left division: 
x=b\A 
x = 

0.7451 -1.0980 0.1176 -0.1373 


The user-defined function LUdecomp below, performs LU decomposition, and returns matrix 
A as A=L*U and the row permutation vector permut. 

function [A,permut] = LUdecomp (A) 

% LU decomposition of matrix A; returns A = L*U 
% and the row permutation vector permut 

n = size(A,1); z = zeros(n,1); 
permut = (1:n)'; 

for i = 1:n; z(i) = max(abs(A(i,1:n))); 
end 

% Exchange rows if necessary 
for k = 1 :n-1 

[Amag,m] = max(abs(A(k:n,k))./z(k:n)); 
m = m + k- 1; 
if Amag < eps 
errorfMatrix is singular 1 ) 
end 


if m ~= k 

z = ExchRows(z,k,m); 
A = ExchRows(A,k,m); 
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permut = ExchRows(permut,k,m); 
end 

% Elimination pass 

fori= k+1:n 
if A(i,k)~=0 
alpha = A(i,k)/A(k,k); 

A(i,k+1 :n) = A(i,k+1 :n) - alpha*A(k,k+1 :n); 
A(i,k) = alpha; 

end 

end 

end 


Example 14.13 

Given that 

-2 5-49 
A = -3 -6 8 1 

7-532 
4-9-8 -1 


use the LUdecomp user-defined function above to decompose matrix A and show how the given 
rows were permuted. 

Solution: 


At the MATLAB command prompt we enter 


A=[-2 5 -4 9; -3 -6 8 1; 7 -5 3 2; 4 -9 -8 -1]; 
[A,permut] = LUdecomp(A) 


7.0000 

-0.4286 

0.5714 

-0.2857 


-5.0000 

-8.1429 

0.7544 

-0.4386 


3.0000 

9.2857 

-16.7193 

-0.0556 


2.0000 

1.8571 

-3.5439 

10.1889 


permut - 

3 
2 

4 
1 

Check: 


14-20 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 








The LU Factorization 


[L,U,P]=lu(A) 


L - 



1.0000 


0 

0 

0 


-0.0612 


1.0000 

0 

0 


0.0816 


-0.1376 

1.0000 

0 


-0.0408 


0.0761 

0.0417 

1.0000 

u = 

7.0000 


-5.0000 

3.0000 

2.0000 


0 


-8.4490 

9.4694 

1.9796 


0 


0 

-15.6612 

-3.4347 


0 


0 

0 

10.2632 

p = 

1 

0 0 

0 




0 

1 0 

0 




0 

0 1 

0 




0 

0 0 

1 




L*U 






ans 

- 






7.0000 


-5.0000 

3.0000 

2.0000 


-0.4286 


-8.1429 

9.2857 

1.8571 


0.5714 


0.7544 

-16.7193 

-3.5439 


-0.2857 


-0.4386 

-0.0556 

10.1889 


The user-defined function LUsolPivot listed below, is saved as LUsolPivot.m and will be used 
in the user-defined function matlnvert that follows. 

% In this user-defined function matrix A and column 
% vector b are entered in MATLAB's command window 
% and “permut” holds the row permutation data. 

% 

function x = LUsolPivot(A,b,permut) 

% 

% The six statements below rearrange vector b and 
% stores it in vector x. 

% 

if size(b) > 1; b = b'; 
end 

n = size(A,1); 
x = b; 

for i = 1:n; x(i)= b(permut(i)); 
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end 

% 

% The next six statements perform forward and 
% backward substitution 

% 

for k = 2:n 

x(k) = x(k)- A(k, 1 :k—1)*x(1 :k—1); 
end 

for k= n:-1:1 

x(k) = (x(k) - A(k,k+1:n)*x(k+1:n))/A(k,k); 
end 

The user-defined function matin vert below, inverts matrix A with LU decomposition. 

% This user-defined function inverts a matrix A 
% defined in MATLAB's command prompt using LU 
% decomposition 

% 

function Ainv = matlnvert(A) 

% 

n = size(A,1); % Assigns the size of A to n. 

% 

Ainv = eye(n); % Creates identity matrix of size n. 

% The statement below performs LU decomposition 
% using the user-defined function LUdecomp(A) saved 
% previously 

% 

[A,permut] = LUdecomp(A); 

% 

% The last three statements solve for each vector 
% on the right side, and store results in Ainv 
% replacing the corresponding vector using the 
% user-defined function LUsolPivot saved previously. 

% 

for i= 1:n 

Ainv(:,i) = LUsolPivot(A,Ainv(:,i),permut); 
end 


Example 14.14 

Invert the matrix A below with the user-defined function matlnvert. 
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-2 5-49 
-3-68 1 

7-532 
4 -9 -8 -1 


Solution: 

In MATLAB’s command prompt we enter 


A=[-2 5 -4 9; -3 -6 8 1; 7 
Ainv = matlnvert(A) 

and MATLAB returns 
Ainv = 

-0.0201 -0.0783 

-0.0013 -0.0719 

-0.0208 0.0369 

0.0981 0.0389 

Check with MATLAB’s built-ii 

inv(A) 

ans = 

-0.0201 -0.0783 

-0.0013 -0.0719 

-0.0208 0.0369 

0.0981 0.0389 


-5 3 2; 4 -9 -8 -1]; 


0.1174 -0.0242 

0.0078 -0.0683 

0.0447 -0.0610 

0.0416 0.0055 

inv(A) function. 


0.1174 -0.0242 
0.0078 -0.0683 
0.0447 -0.0610 
0.0416 0.0055 


14.6 The Cholesky Factorization 

A matrix is said to be positive definite if 

x T • A • x > 0 (14.25) 

for every x ^ 0 and A is symmetric, that is, A T = A. Under those conditions, there exists an 
upper triangular matrix G with positive diagonal elements such that 

G T • G = A (14.26) 

Relation (14.26) is referred to as Cholesky factorization. It is a special case of LU factorization 
and requires fewer computations than the LU factorization method of the previous section. Let 
us invoke the MATLAB help chol command to see how MATLAB performs this factorization. 
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CHOL Cholesky factorization. 

CHOL(X) uses only the diagonal and upper triangle of X. 

The lower triangular is assumed to be the (complex conjugate) 
transpose of the upper. If X is positive definite, then 
R = CHOL(X) produces an upper triangular R so that R'*R = X. 
If X is not positive definite, an error message is printed. 

[R,p] = CHOL(X), with two output arguments, never produces an 
error message. If X is positive definite, then p is 0 and R 
is the same as above. But if X is not positive definite, 
then p is a positive integer. 

We will consider an example using the Cholesky factorization after we review the MATLAB 
functions eye(n) and diag(v,k) as defined by MATLAB. 

help eye 

EYE Identity matrix. 

EYE(N) is the N-by-N identity matrix. 

EYE(M,N) or EYE([M,N]) is an M-by-N matrix with l's on 
the diagonal and zeros elsewhere. 

EYE(SIZE(A)) is the same size as A. 

See also ONES, ZEROS, RAND, RANDN. 

help diag 

DIAG Diagonal matrices and diagonals of a matrix. 

DIAG (V, K) when V is a vector with N components is a square 
matrix of order N+ABS(K) with the elements of V on the K-th 
diagonal. K = 0 is the main diagonal, K > 0 is above the main 
diagonal and K < 0 is below the main diagonal. 

DIAG(V) is the same as DIAG(V,0) and puts V on the main diagonal. 

DIAG(X,K) when X is a matrix is a column vector formed from 
the elements of the K-th diagonal of X. 

DIAG (X) is the main diagonal of X. DIAG (DIAG (X) ) is a diagonal 
matrix. 

Example 
m = 5 ; 

diag(-m:m) + diag(ones(2*m,1),1) + diag(ones(2*m,1),-1) 
produces a tridiagonal matrix of order 2*m+l. 

See also SPDIAGS, TRIU, TRIL. 


14-24 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 





The QR Factorization 


Example 14.15 

Use MATLAB to compute the Cholesky factorization of matrix A as defined below. 

format bank; B=[-0.25 -0.50 -0.75 -1.00]; 

A=5*eye(5)+diag(B, -1)+diag(B, 1), G=chol(A), A1=G'*G 

Solution: 

Execution of the MATLAB script above displays the following: 

A = 


5.00 

-0.25 

0 

0 

0 

-0.25 

5.00 

-0.50 

0 

0 

0 

-0.50 

5.00 

-0.75 

0 

0 

0 

-0.75 

5.00 

-1.00 

0 

0 

0 

-1.00 

5.00 

2.24 

-0.11 

0 

0 

0 

0 

2.23 

-0.22 

0 

0 

0 

0 

2.22 

-0.34 

0 

0 

0 

0 

2.21 

-0.45 

0 

0 

0 

0 

2.19 

5.00 

-0.25 

0 

0 

0 

-0.25 

5.00 

-0.50 

0 

0 

0 

-0.50 

5.00 

-0.75 

0 

0 

0 

-0.75 

5.00 

-1.00 

0 

0 

0 

-1.00 

5.00 


We observe that A1 = A, that is, the matrix product G T • G = A is satisfied. 


14.7 The QR Factorization 

The QR factorization decomposes a matrix A into the product of an orthonormal matrix and an 
upper triangular matrix. The MATLAB function [Q,R]=qr(A) produces an n x n matrix whose 
columns form an orthonormal or unitary matrix Q and an upper triangular matrix R of the 
same size as matrix A. In other words, A can be factored as 

A = QR (14.27) 


* An n x n matrix A is called unitary if (A*) T = A 1 where A* is the complex conjugate matrix of A . 
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Then, a system described by Ax = b becomes 

QRx = b (14.28) 

and multiplying both sides of (14.28) by Q ■ Q T = I we obtain 

Rx = Q T b (14.29) 

The MATLAB [Q,R]=qr(A) is described as follows: 

help qr 

QR Orthogonal-triangular decomposition. 

[Q/R] = QR(A) produces an upper triangular matrix R of the same 
dimension as A and a unitary matrix Q so that A = Q*R. 

[Q,R,E] = QR(A) produces a permutation matrix E, an upper 
triangular R and a unitary Q so that A*E = Q*R. The column 
permutation E is chosen so that abs(diag(R)) is decreasing. 

[Q/R] = QR(A,0) produces the "economy size" decomposition. 

If A is m-by-n with m > n, then only the first n columns of Q 
are computed. 

Q,R,E] = QR(A,0) produces an "economy size" decomposition in 
which E is a permutation vector, so that Q*R = A(:,E). The col¬ 
umn permutation E is chosen so that abs(diag(R)) is decreasing. 

By itself, QR(A) is the output of LAPACK'S DGEQRF or ZGEQRF rou¬ 
tine. TRIU(QR(A)) is R. 

R = QR(A) returns only R. Note that R = chol(A'*A). 

[Q,R] = QR(A) returns both Q and R, but Q is often nearly full. 
C,R] = QR(A,B), where B has as many rows as A, returns C = Q'*B. 
R = QR(A,0) and [C,R] = QR(A,B,0) produce economy size results. 

The full version of QR does not return C. 

The least squares approximate solution to A*x = b can be found 
with the Q-less QR decomposition and one step of iterative 
refinement: 

x = R\(R'\(A'*b)) 
r = b - A*x 
e = R\(R'\(A'*r) ) 
x = x + e; 
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Example 14.16 

Given that 


A = 

2 -3 1 

-1 5 -2 

and b = 

2 

4 


3-8 4 


_5 


solve Ax = b using the MATLAB function [Q,R]=qr(A) and x = R\Q T b. 

Solution: 

A=[2 -3 1; -1 5 -2; 3 -8 4]; b=[2 4 5]'; [Q,R]=qr(A), x=R\Q'*b 


-0.53 

-0.62 

-0.58 

0.27 

-0.77 

0.58 

o 

o 

0.15 

0.58 

-3.74 

9.35 

-4.28 

0 

-3.24 

1.54 

0 

0 

0.58 


4.14 

4.43 

7.00 

Check=A\b 

Check = 

4.14 

4.43 

7.00 

Let us verify that the matrix Q is unitary. Of course, since the elements are real numbers, the 
complex conjugate of Q is also Q and thus we only need to show that Q T = Q 1 or Q • Q T = I. 

Q*Q' 

ans = 

1.00 0.00 - 0.00 

0.00 1.00 - 0.00 

- 0.00 - 0.00 1.00 
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QR factorization is normally used to solve overdetermined systems, that is, systems with more 
equations than unknowns as in applications where we need to find the least square distance in lin¬ 
ear regression. In an overdetermined system, there is no vector X which can satisfy the entire sys¬ 
tem of equations, so we select the vector X which produces the minimum error. MATLAB does 
this with either the left division operator ( \ ) or with the non-negative least-squares function 
lsqnonneg(A,b). This function returns the vector X that minimizes norm(A*X-b) subject to 
X > 0 provided that the elements of A and b are real numbers. For example, 

A=[2 -3 1; -1 5 -2; 3 -8 4]; b=[2 4 5]'; X=lsqnonneg(A,b) 
returns 
X = 

4.1429 

4.4286 

7.0000 

Underdetermined systems have infinite solutions and MATLAB selects one but no warning mes¬ 
sage is displayed. 

As we’ve learned in Chapter 4, the MATLAB function inv(A) produces the inverse of the square 
matrix A and an error message is displayed if A is not a square matrix. The function pinv(A) dis¬ 
plays the pseudoobtaininverse of a m x n (non-square) matrix A. Of course, if A is square, then 

pinv(A)=inv(A). 

14.8 Singular Value Decomposition 

The Singular Value Decomposition (SVD) method decomposes a matrix A into a diagonal matrix 
S , of the same dimension as A and with nonnegative diagonal elements in decreasing order, and 
unitary matrices U and V so that 

A = U-S-V t (14.30) 

The matrices U, S, and V, decomposed from a given matrix A, can be found with the MATLAB 
function [U, S, V]=svd(A). 


Example 14.17 
Decompose the matrix 


* We defined overdetermined and underdetermined systems in Chapter 8 
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2 -3 1 




A = 

-1 5 -2 





3-8 4_ 


into two unitary matrices and 

diagonal matrix with non-negative elements. 

Solution: 




We will use the MATLAB [U, S, V]=svd(A) function. 

A=[2 -3 1; -1 

5 -2; 3 -8 

4]; [U,S,V]=svd(A) 

U = 




-0.3150 

-0.8050 

-0.5028 


0.4731 

-0.5924 

0.6521 


-0.8228 

-0.0325 

0.5675 


S = 




11.4605 

0 

0 


0 

1.1782 

0 


0 

0 

0.5184 


V = 




-0.3116 

-0.9463 

0.0863 


0.8632 

-0.2440 

0.4420 


-0.3972 

0.2122 

0.8929 


As expected, the diagonal elements of the triangular S 

matrix are non-negative and in decreas- 

ing values. We also verify that 

the matrices U and V are unitary as shown below. 

U*U' 




ans = 




1.0000 

- 0.0000 

- 0.0000 


- 0.0000 

1.0000 

0.0000 


- 0.0000 

0.0000 

1.0000 


V*V' 




ans = 




1.0000 

- 0.0000 

0.0000 


- 0.0000 

1.0000 

- 0.0000 


0.0000 

- 0.0000 

1.0000 
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14.9 Summary 

• Orthogonal functions are those which are perpendicular to each other. 

• Two families of curves with the property that each member of either family cuts every member 
of the other family at right angles are said to be orthogonal trajectories of each other. 

• The inner (dot) product of two vectors X = [xj x 2 x 3 ... x n ] and Y = [y, y 2 y 3 ... yj is 
a scalar defined as X • Y = Xj yj + x 2 y 2 + x 3 y 3 + ... + x n y n 

• If the dot product of two vectors X 3 and X 2 is zero, these vector are said to be orthogonal to 
each other. 

• The magnitude of a vector X , denoted as X, is defined as |X| = + x 2 + ... + xjj. A unique 

unit vector U is obtained by dividing each component of X by the magnitude |X| and this pro¬ 
cess is referred to as normalization. 

• A basis that consists of mutually orthogonal vectors is referred to as an orthogonal basis. If 
these vectors are also unit vectors, the basis is called orthonormal basis. 

• If the column (or row) vectors of a square matrix A are mutually orthogonal unit vectors, the 

matrix A is said to be orthogonal and A • A T = I where A T is the transpose of A and I is the 
identity matrix. 

• We can find an orthonormal set of eigenvectors in a 2x2 matrix easily from the eigenvalues 
but the computations for finding orthonormal sets of eigenvectors for larger size (3x3 or 
higher) matrices using the above procedure becomes quite involved. A simpler procedure is 
the Gram-Schmidt orthogonalization procedure which we will discuss on the next section. 

• The LU factorization method decomposes a matrix A into a lower triangular matrix L and an 
upper triangular matrix U so that A = L • U . The MATLAB function [L,U]=lu(A) decomposes 
the matrix A into a lower triangular matrix L and an upper triangular matrix U . 

• A matrix is said to be positive definite if x T • A • x > 0 for every x ^ 0 and A is symmetric, that 
is, A T = A. Under those conditions, there exists an upper triangular matrix G with positive 
diagonal elements such that G T • G = A. This process is referred to as the Cholesky factoriza¬ 
tion. 

• The QR factorization decomposes a matrix A into the product of an orthonormal matrix and 
an upper triangular matrix. The MATLAB function [Q,R]=qr(A) produces an nxn matrix 
whose columns form an orthonormal or unitary matrix Q and an upper triangular matrix R of 
the same size as matrix A. 
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Summary 

• The Singular Value Decomposition (SVD) method decomposes a matrix A into a diagonal 
matrix S , of the same dimension as A and with nonnegative diagonal elements in decreasing 
order, and unitary matrices U and V so that A = U • S • V T . The matrices U, S, and V, 
decomposed from a given matrix A, can be found with the MATLAB function [U, S, 
V]=svd(A). 
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14.10 Exercises 


1. Show that the curve x 2 + 3y 2 = k, and the curve 3y = k 2 x 3 where kj and k 2 are constants, 
are orthogonal to each other. 

2. Find the orthogonal trajectories of the curves of the family 2x 2 + y 2 = kx 

3. Given the vectors X, = [2 - 1] T and X 2 = [1 — 3] T , use the Gram-Schmidt orthogonal- 

ization procedure to find two vectors Y, and Y 2 to form an orthonormal basis. 

4. Use MATLAB to find another set of an orthonormal basis with the vectors given in Exercise 3. 

5. Use the Gaussian elimination method as in Example 14.8 to decompose the system of equa¬ 
tions 

x x + 2x 2 + 3x 3 = 14 
-2x x + 3x 2 + 2x 3 = 10 
5xj-8x 2 + 6x 3 = 7 

into an upper triangular matrix U and a lower triangular matrix L. Verify your answers with 
MATLAB. 


6. Using the MATLAB functions eye(n) and diag(v,k) to define and display the matrix A shown 
below. 


4.00 -0.80 0 

-0.80 4.00 -1.00 

0 -1.00 4.00 

0 0 - 1.20 


0 

0 

- 1.20 

4.00 


Then, use the MATLAB Cholesky factorization function to obtain the matrix G and verify 
that G T • G = A. 

7. Use the appropriate MATLAB function to decompose the system of equations 



1 0 -1 


3 

A = 

0 1 2 

and b = 

5 


-2 -3 4 


9 


into an upper triangular matrix R of the same dimension as A and a unitary matrix Q so that 
Q • R = A. Use a suitable function to verify your results. 
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8. Use the appropriate MATLAB function to decompose the matrix A given as 


1 0 -1 
0 1 2 
—2 -3 4_ 


into a diagonal matrix S of the same dimension as A and with non-negative diagonal ele¬ 
ments in decreasing order and unitary matrices U and V so that U • S • V T = A. 
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14.11 Solutions to End-of-Chapter Exercises 

1 . 

x 2 + 3y 2 = k 1 (1) 


3y = k 2 x (2) 


Implicit differentiation of (1) yields 


2x + 6y^ = 0 
dx 


Differentiation of (2) yields 

From (2), 


& = (3) 

dx 3 y 


- 3 -if = k 2 x ; (4) 

dx 3 




and by substitution into (4) we obtain 


? = = (5) 

dx x 3 x 

We observe that (5) is the negative reciprocal of (3) and thus the given curves are orthogonal 
to each other. 


2 . 

2x 2 + y 2 = kx (1) 

Implicit differentiation of (1) yields 


and solving for dy/dx, 
From (1), 


d 2. d 2 d ,, v 

dt (2x)+ at y =dt (kx) 

4x + 2y^ = k 
dx 


£-4r <2) 
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and by substitution into (2) 


dy _ 


k = (3) 


r, 2 2 

?5-!i-4x „ 2 2 

x -2x +’• 


(4) 


dx 2y 2xy 

Now, we need to find the curves whose slopes are given by the negative reciprocal of (4), that 
is, we need to find the family of the curves of 

. _2 
T 2 

2x -y 

We rewrite (5) as 


= AA (5) 

dx 9 2 V 2 


and we let y = ux. Then, dy = udx + xdu and by substitution into (6) 
(2x 2 -u 2 x 2 )(udx + xdu) = 2x 2 udx 
Division of both sides of the above by x 2 yields 

(2 -u 2 ) (udx + xdu) = 2udx 
Collecting like terms and simplifying we obtain 


Separating the variables we obtain 

dx = (2V) du = ! du _du 
x u 3 u 3 u 

or 

dx du _ 

x 

and by integrating these terms we find 

In |x| + In |u| = -y + C 

By substitution of u = y/x we obtain 
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and thus the family of curves orthogonal to the given family is 
x 2 = -y 2 ln|Cy| 

From (14.14) 


Yj = Xj = [2 -l] 1 

•X, 


[2 - 1 ] • [2 - l] 1 


= n -1] T = U -3] T -1 - [2 -1] T = 

= [1 - 3 ] T - [2 - 1 ] T = [-1 2 ] T 


and from (14.15) 

U, = ||| = [2/75 -1/75] 1 

u 2 = = r-i/75 -2/75] T 

| Y f| 

and denoting the matrix whose elements are the unit vectors as A, we have: 


2/75 

-1/75 


-1/75 

-2/75 


We verify that A • A T = I as shown below. 


2/75 

-1/75 


2/75 

-1/75 

-1/75 

-2/75 


-1/75 

-2/75 


4/5+ 1/5 -2/5 + 2/5 = |~1 ol 

-2/5+ 2/5 1/5 + 4/5J [o lj 


A=[2 -1; 1 -3]; B=orth(A) 

B = 

-0.5257 -0.8507 
-0.8507 0.5257 


l=B*B' 
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1.0000 -0.0000 

-0.0000 1.0000 

Xj + 2 x 2 + 3x 3 = 14 
-2x x + 3 x 2 + 2x 3 = 10 (1) 

5XJ-8X2 + 6x 3 = 7 

Multiplying the first equation of (1) by -2 and subtracting it from the second in (1) we obtain 
the second equation in (2) and thus Xj is eliminated. Likewise, we multiply the first equation 
by 5 and we subtract it from the third in (1). Then, 

Xj + 2 x 2 + 3x 3 = 14 

7x 2 + 8x3 = 38 (2) 

-18x 2 -9x 3 = -63 

Next, we multiply the second equation in (2) by -18/7 and we subtract it from the third in 
(2). Then, after simplification 

x t + 2 x 2 + 3x 3 = 14 

7x 2 + 8x3 = 38 (3) 

(81/7)x 3 = 243/7 

Thus, 

x 3 = 243/81 = 3 
x 2 = (38 - 8x 3 )/7 = 2 
Xj = (14-3 x 3 -2x 2 ) = 1 

The multipliers that we’ve used are -2,5, and -18/7 . These are the elements L 21 , L 31 , and 
L 32 respectively. Therefore, the lower triangular matrix is 

1 0 0 
L = -2 1 0 
5 -18/7 1 


The elements of the upper triangular matrix are the coefficients of the unknowns in (3) and 
thus 


2 3 

7 8 

0 81/7 
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Now, we use MATLAB to verify that L • U = A 

L=[1 0 0;-2 1 0;5 -18/7 1]; U=[1 2 3; 0 7 8; 0 0 81/7]; A=L*U 


1 

-2 

5 


3 

2 

6 


format bank; B=[-0.8 -1.0 -1.2]; 

A=4*eye(4)+diag(B, -1)+diag(B, 1), G=chol(A), A1=G'*G 


A - 

4.00 

-0.80 

0 

0 

G = 

2.00 

0 

0 

0 

A1 = 

4.00 

-0.80 

0 

0 


-0.80 

4.00 

- 1.00 

0 


-0.40 

1.96 

0 

0 

-0.80 

4.00 

- 1.00 

0 


0 

- 1.00 

4.00 

- 1.20 


0 

-0.51 

1.93 

0 

0 

- 1.00 

4.00 

- 1.20 


7. 


0 

0 

- 1.20 

4.00 


0 

0 

- 1.20 

4.00 


A=[1 0 -1;0 1 2;-2 -3 4]; b=[3 5 9]'; 
[Q,R]=qr(A), QQT=Q*Q', x=R\Q'*b, Check=A\b 


-0.4472 

0.7171 

0.5345 

0 

-0.5976 

0.8018 

0.8944 

0.3586 

0.2673 

-2.2361 

-2.6833 

4.0249 

0 

-1.6733 

-0.4781 

0 

0 

2.1381 
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QQT = 

1.0000 

0.0000 

0.0000 

0.0000 

1.0000 

0.0000 

0.0000 

0.0000 

1.0000 

x = 

6.7500 

-2.5000 

3.7500 

Check = 

6.7500 

-2.5000 

3.7500 

8. 

A=[1 0 -1; 0 1 

2; -2 -3 4]; 


[U,S,V]=svd(A), 

C 

c 
—1 
II 

c 

c 

< 

< 

H 

< 

< 

u = 

-0.2093 

-0.2076 

-0.9556 

0.1977 

0.9480 

-0.2493 

0.9577 

-0.2410 

-0.1574 

S - 

5.5985 

0 

0 

0 

2.0413 

0 

0 

0 

0.7000 

V = 

-0.3795 

0.1345 

-0.9154 

-0.4779 

0.8187 

0.3184 

0.7922 

0.5583 

-0.2464 

UUT = 

1.0000 

0.0000 

0.0000 

0.0000 

1.0000 

0.0000 

0.0000 

0.0000 

1.0000 

WT = 

1.0000 

0.0000 

-0.0000 

0.0000 

1.0000 

-0.0000 

-0.0000 

-0.0000 

1.0000 
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Chapter 15 


Bessel, Legendre, and Chebyshev Functions 


T his chapter is an introduction to some very interesting functions. These are special func¬ 
tions that find wide applications in science and engineering. They are solutions of differen¬ 
tial equations with variable coefficients and, under certain conditions, satisfy the orthogo¬ 
nality principle. 

15.1 The Bessel Function 

The Bessel functions, denoted as J n (x), are used in engineering, acoustics, aeronautics, thermody¬ 
namics, theory of elasticity and others. For instance, in the electrical engineering field, they are 
used in frequency modulation, transmission lines, and telephone equations. 

Bessel functions are solutions of the differential equation 



(15.1) 


where n can be any number, positive or negative integer, fractional, or even a complex number. 
Then, the form of the general solution of (15.1) depends on the value of n. 

Differential equations with variable coefficients, such as (15.1), cannot be solved in terms of 
familiar functions as those which we encountered in ordinary differential equations with constant 
coefficients. The usual procedure is to derive solutions in the form of infinite series, and the most 
common are the Method of Frobenius and the Method of Picard. It is beyond the scope of this book 
to derive the infinite series which are approximations to the solutions of these differential equa¬ 
tions; these are discussed in advanced mathematics textbooks. Therefore, we will accept the solu¬ 
tions without proof. 

Applying the method of Frobenius to (15.1), we obtain the infinite power series 



(15.2) 


k = 0 


This series is referred to as Bessel function of order n where n is any positive real number or zero. If 
in (15.2), we replace n with -n, we obtain the relation 
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k!-T(-n + k+ l) 


and the function J_ n (x) is referred to as the Bessel function of negative order n. 
For the special case where n is a positive integer or zero, 

/fn + k + 1) = (n + k)! 

and (15.2) reduces to 

j„<x)= iv - i) 1 -©" 21 


k! ■ (n + k)! 


J n (x) = -^-{l---^- 

2 -nil 2 2 - 1! ■ (n + 


(n+1) 2 ■ 2! ■ (n + l)(n + 2) 

6 

-*-4 

2 • 3! •(n + l)(n + 2)(n + 3) 

For n = 0, 1 and 2, (15.6) reduces to the following series: 


J 0 ( x ) = 1 - - 


hOO - f" 


2 2 3 ■ 1 ! 


2 ■ 1! ■ 2! 2-21-3! 2-31-4! 2-41-5! 


J 2 (x) = - 


2-2! 2-11-3! 2-21-4! 2-31-5! 2-41-6! 


(15.3) 

(15.4) 

(15.5) 

(15.6) 

(15.7) 

(15.8) 

(15.9) 


We observe from (15.7) through (15.9), that when n is zero or even, J n (x) is an even function of 
x, and odd when n is odd. 


If we differentiate the series of J 0 (x) in (15.7), and compare with the series of J, (x) in (15.8), we 
see that 

(15.10) 


Also, if we multiply the series for J, (x) by x and differentiate it, we will find that 


J 0 (x) = -Jj(x) 
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The Bessel Function 


d_ 

dx 


{xJj(x)} = xJ 0 (x) 


(15.11) 


Example 15.1 

Compute, correct to four decimal places, the values of 

a. J 0 (2) b. J!(3) c. J 2 (l) 


Solution: 


From (15.7), 


64 


256 


1 


43 


4 64 64x 36 256 x 576 4 36 576 192 

or from math tables, J 0 (2) = 0.2239 


b. 

From (15.8), 


j m = 3 27 { 243 2187 

' 2 16 384 18432 


19683 

1474560 


= 0.3400 


or from math tables, J 2 (3) = 0.3391 


c. 

From (15.9), 


8 96 + 1536 184320 


1 

17694720 


0.1152 


or from math tables, J 2 (l) = 0.1149. 

We can use the MATLAB besselj(n,x) function or the Excel E3ESSELJ(x,n) function for the 
above computations. With MATLAB, we obtain 

besselj(0,2), besselj(1,3), besselj(2,1) 

ans = 

0.2239 
ans = 

0.3391 
ans = 

0.1149 
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and with Excel, 

besselj(2,0)= 0.2239 besselj(3,1 )= 0.3391 besselj(1,2)= 0.1149 


The MATLAB script below plots J 0 (x), Jj(x), and J 2 (x). 

x = 0.00: 0.05: 10.00; v = besselj(0,x); w = besselj(l.x); z = besselj(2,x); 
plot(x,v,x,w,x,z); grid; title('Bessel Functions of the First Kind 1 ); xlabel('x'); ylabel('Jn(x)'); 
text(0.95, 0.85, 'JO(x)'); text(2.20, 0.60, 'JI(x)'); text(4.25, 0.35, 'J2(x)') 

The plots for J 0 (x), J, ( x ) and J 2 (x) are shown in Figure 15.1. 



Figure 15.1. Plots of J 0 (x), Jj(x) and J 2 (x) using MATLAB 
We can also use Excel to plot these series as shown in Figure 15.2. 

The definition of a Bessel function of the first kind will be explained shortly. 

The x-axis crossings in the plot of Figures 15.1 and 15.2 show the first few roots of the J 0 (x), 
Jjlx), and J 2 (x) series. However, all J n (x) are infinite series and thus, it is a very difficult and 
tedious task to compute all roots of these series. Fortunately, tables of some of the roots of J 0 (x) 
and J j (x) are shown in math tables. 


* In Frequency Modulation (FM), x is denoted as (3 and it is called modulation index. The functions J 0 (P), J, ( P), J 2 (P) 
and so on, represent the carrier, first sideband, second sideband etc. respectively. 
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The Bessel Function 


Plot of Bessel Function Jn(x) for n = 0, 1 and 2 


X Jo(x) Ji(x) 

0.00 1.0000 0.0000 

0.05 0.9994 0.0250 

0.10 0.9975 0.0499 

0.15 0.9944 0.0748 

0.20 0.9900 0.0995 

0.25 0.9844 0.1240 

0.30 0.9776 0.1483 

0.35 0.9696 0.1723 

0.40 0.9604 0.1960 

0.45 0.9500 0.2194 

0.50 0.9385 0.2423 

0.55 0.9258 0.2647 

0.60 0.9120 0.2867 

0.65 0.8971 0.3081 

0.70 0.8812 0.3290 

0.75 0.8642 0.3492 


J 2 (x) 

0.0000 

0.0003 

0.0012 

0.0028 

0.0050 

0.0078 

0.0112 

0.0152 

0.0197 

0.0249 

0.0306 

0.0369 

0.0437 

0.0510 

0.0588 

0.0671 



Figure 15.2. Plots of J 0 (x), J^x) and J 2 (x) usingExcel 


The equations J 0 (x) = 0 and J,(x) = 0 exhibit some interesting characteristics. The most note¬ 
worthy are: 

1. They have no complex roots 

2. Each has an infinite number of distinct real roots 

3. Between two consecutive roots of one of these equations lies one and only one root of the 
other equation, that is, the roots of these equations separate each other. This is observed on 
Table 15.1 which shows the first 5 positive roots of these equations, and the differences 
between consecutive roots. For instance, we observe that the first root 3.8317 of J, (x) lies 
between the roots 2.4048 and 5.5201 of J 0 (x). 

4. As the roots become larger and larger, the difference between consecutive roots approaches 
the value of n, that is, J 0 (x) and J 1 (x), are almost periodic with period almost 2n. In other 
words, these series behave like the cosx and sinx functions. 

If n is half of an odd integer, such as 1 /2, 3/2, 5/2, and so on, then J n (x) can be expressed in a 
finite form of sines and cosines. Consider, for example, the so-called half-order Bessel functions 
J 1/2 (x) and J(_ 1/2 )(x) . If we let n = 1/2 in (15.2), we obtain 


J l /2C X ) 


[2 ■ 

— sinx 
ynx 


(15.12) 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


15-5 













Chapter 15 Bessel, Legendre, and Chebyshev Functions 


TABLE 1 5 .1 The first few roots of J 0 (x) and J j (x) 


J 0 (x) = 0 

Jj(x) = 0 

Roots 

Differences 

Roots 

Differences 

2.4048 


3.8317 



3.1153 


3.1839 

5.5201 


7.0156 



3.1336 


3.1579 

8.6537 


10.1735 



3.1378 


3.1502 

11.7915 


13.3237 



3.1394 


3.1469 

14.9309 


16.4706 











Likewise, if we let n = 1/2 in (15.3), we obtain 



Example 15.2 

Compute, correct to four decimal places, the values of 

a - J (-i/2)(f) 

Solution: 

a. Using (15.12), 

, 2 sin(7t/4) = iV8-^ = — = - = 0.6366 

1/2 V4 ) Vn(7i/4) n 2 2n n 

b. Using (15.13). 

J, 1 / 2 / 7 ) = / 2 cos(7t/4) = = - = 0.6366 

( - 1/2) V4/ y 7l(7l/4) ' 71 2 71 

Check with MATLAB: 

besselj(0.5,pi/4), besselj(-0.5,pi/4) 


15-6 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 

























The Bessel Function 


ans 


0.6366 


ans 


0.6366 


The Bessel functions which we have discussed thus far, are referred to as Bessel functions of the first 
kind. Other Bessel functions, denoted as Y n (x) and referred to as Bessel functions of the second 
kind, or Weber functions, or Neumann functions. These are additional solutions of the Bessel’s equa¬ 
tion, and will be explained in the next paragraph. Also, certain differential equations resemble 
the Bessel equation, and thus their solutions are called Modified Bessel functions, or Hanltel func¬ 
tions. 

As mentioned earlier, a Bessel function J_ n (x) for n > 0, can be obtained by replacing n with -n 
in (15.2). If n is an integer, we will prove that 


J_n(x) = (-l) n J n (x) 
for n = 1, 2, 3, ... 


(15.14) 


Proof: 

From (15.3). 



(15.15) 



Now, we recall from Chapter 13, that the numbers n = 0, -1, -2, ... yield infinite values in T(n); 
then, the first summation in the above relation is zero for k = 0, 1, 2, ..., n - 1. Also, if we let 
k = n + m in the second summation, after simplification and comparison with (15.5), we see that 


y (~l) n + m ■ (x/2 C n + 2n ~ 
2-* (n + m)! • /fm + 1) 



m = 0 


and thus (15.14) has been proved. 
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It is shown in advanced mathematics textbooks that, if n is not an integer, J n (x) and J_ n (x) are 
linearly independent; for this case, the general solution of the Bessel equation is 


y = AJ n (x) + BJ_ n (x) 
n*0, 1,2,3, ... 


(15.16) 


For n = 1, 2, 3, ... and so on, the functions J n (x) and J_ n (x) are not linearly independent as we 
have seen in (15.14); therefore, (15.16) is not the general solution, that is, for this case, these two 
series produce only one solution, and for this reason, the Bessel functions of the second kind are 
introduced to obtain the general solution. 


The following example illustrates the fact that when n is not an integer or zero, relation (15.16) is 
the general solution. 


Example 15.3 

Find the general solution of Bessel’s equation of order 1/2. 

Solution: 

By the substitution n = 1/2 in (15.1), we obtain 


2 d y 

x TT 

dx 


dy f 2 14 

X-2-+ x 
dx V 4 ) 


We will show that the general solution of (15.17) is 

y = AJ 1 / 2 (x) + BJ_ 1 / 2 (x) 

By substitution of (15.12) and (15.13) into (15.18), we obtain 



and letting Cj = Aj2/n and C 2 = Bj2/n , (15.19) can be written as 


(15.17) 


(15.18) 


(15.19) 


y = Cj 


sinx „ cosx 

[ ~r + ^ 2 ~T~ 

dx Jx 


(15.20) 


Since the two terms on the right side of (15.20) are linearly independent, y represents the general 
solution of (15.17). 
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The Bessel functions of the second kind, third kind, and others, can be evaluated at specified val¬ 
ues either with MATLAB or Excel. The descriptions, syntax, and examples for each can be found 
by invoking help bessel for MATLAB, and help for Excel. 

One very important property of the Bessel’s functions is that within certain limits, they constitute 
an orthogonal system. For instance, if a and b are distinct roots of J 0 (x) = 0, J 0 (a) = 0 and 
J 0 (b) = 0 , then, 

f xJ 0 (ax)J 0 (bx)dx = 0 (15.21) 

J o 


and we say that J 0 (ax) and J 0 (bx) are orthogonal in the interval 0 < x < 1. They are also orthog¬ 
onal with the variable x. 


The function 



e 


J J n ( x )t n 


(15.22) 


is referred to as the generating function for Bessel functions of the first kind of integer order. Using this 
function, we can obtain several interesting properties for integer values of n. Some of these are 
given below without proof. More detailed discussion and proofs can be found in advanced mathe¬ 
matics textbooks. 

£ J n 2 (x) = 1 (15.23) 


cos(xsin(|>) = J 0 (x) + 2 ^ J 2k (x)cos2k(j) 

k = l 

sin(xsin(|)) = 2 ^ J 2k _ 1 (x)sin(2k - l)<j> 


(15.24) 


where the subscript 2k denotes that the first relation is valid for even values of k, whereas 2k - 1 
in the second, indicates that the second relation is valid for odd values of k. Also, 


[ cosn(|) ■ cos(xsin(|))d(|) = 

J o 

[ sinn(|) • sin(xsin(|))d(|> = 


7iJ n (x) n = even 
0 n = odd 


JO n 

1 7iJ n ( x ) n 


(15.25) 


= even 
= odd 


* Two functions constitute an orthogonal system., when the average of their cross product is zero within some specified limits. 
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J » = If 

KJ n 


cos(n(|) - xsin<() 


(15.26) 


Relations (15.23) through (15.26) appear in frequency modulation. For example, the average 
power is shown to be 


and with (15.23), it reduces to 


S j2(p> 


- K 


15.2 Legendre Functions 

Another second-order differential equation with variable coefficients is the equation 


(1 -x 2 )^4-2x^ + n(n+ l)y = 0 
dx 2 dx 


(15.27) 


known as Legendre’s equation. Here, n is a constant, and if it is zero or a positive integer, then 
(15.27) has polynomial solutions of special interest. 

Applying the method of Frobenius, as in the Bessel equation, we obtain two independent solu¬ 
tions y l and y 2 as follows. 


y, = ,„[l - + (n - 2 M” + 1 >< n + 3 > x 4 - ...] (15.28) 

y ; = . l [x- (n - 1 > ( , n + 2) x 3 + (n - 3)(n - 1) 5 ( , n + 2)(n + 4) x i -...] (15.29) 

where a 0 and a, are constants. We observe that yj is an even function of x, while y 2 is an odd 
function. Then, the general solution of (15.27) is y = yj + y 2 or 


+ a, [x - ( n ~ 1 ^ + 2 ^ x 3 + (° ~ 3 ^ n ~ + 2 )( n + 4 ) x s —..] 

and this series is absolutely convergent for |x| > 1. 


(15.30) 
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The parameter n is usually a positive integer. If n is zero, or an even positive integer, the first 
term on the right side of (15.30) contains only a finite number of terms; if it is odd, the second 
term contains only a finite number of terms. Therefore, whenever n is zero or a positive integer; 
the general solution of Legendre’s equation contains a polynomial solution which is denoted as 
P n (x), and an infinite series solution which is denoted as Q n (x). 


The Legendre polynomials are defined as 


p 0 (x) - (-d- /2 - 1 ' 2 3 ; 4 5 ; 6 ;>- 1) [i- c - i ^x%...] 

for n = 0 or n = even integer 


P„(x) = (-1)' 


(n- l)/2 1 • 3 • 5 • 


2-4-6 
for n = odd integer 


■ • ' n f (n- l)(n + 2) 3 
(n-l)L 3! 


(15.31) 


(15.32) 


and these are also referred to as surface zonal harmonics. The infinite series solution Q n (x) is 
referred to as Legendre functions of the second kind. These become infinite as x -> +1 and their 
applications to science and engineering problems are very limited. Accordingly, they will not be 
discussed in this text. 

The even and odd functions of (15.31) and (15.32) can be combined to a single relation as 


P„(x) - f (-1) (2n-2k)! x „- 2t 

k = o 2 n k!(n - k)!(n-2k)t 

where N = ^ for n = even and N = ^ ^ for n - odd 

2 2 


(15.33) 


From (15.33), or (15.31) and (15.32), we obtain the following first 6 Legendre polynomials. 


* Assume that the infinite series ^ u n (x 0 ) = U[(x 0 ) +u 2 (x 0 ) + ... converges, i.e., reaches a limit. If, when we replace the 

n = 1 

terms of this series by their absolute value, we find that the resulting series ^ |u n (x 0 )| = | u i( x o)| + | u 2 ( x o)| + ••• 
converges, this series is said to be absolutely convergent. 
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p 0 (x) = 1 

Pl(x) = X 

P 2 (x) = |(3x 2 - 1) 

p 3( x ) = |(5 x 3 -3x) 

n 

** 

o 

+ 

P 5 (x) = ^(63x 5 - 70x 3 + 15x) 


(15.34) 


(15.35) 

2“.n! dx“ 

is known as Rodrigues’ formula, and offers another method of expressing the Legendre polynomials. 
We prove (15.35) as follows. 

From the binomial theorem, 


(x 2 _l) n - V (-1) • n! 2 n- 2 k 
( } 2-i k! • (n-k)! 

k = 0 ' ’ 

and differentiation of (15.36) with respect to x n times yields 


— n ( x - 1 ) = X 

dx k = n 


(-1) -nl . ( 2 n- 2 k)! ,- 2 k 

k!(n-k)! (n-2k)! 


(15.36) 


(15.37) 


Now, by comparison with (15.33), we recognize (15.37) as 2 n • n! • P n (x) and thus (15.35) is 
proved. 

Another important identity involving Legendre polynomials, is the generating function for Legendre 
polynomials which is defined as 


; = P 0 (x) + P 1 (x)t + P 2 (x)t 2 +...+P n (x)t n = £p n (x)t n 


J 1 -2xt + T 

We will illustrate the use of the Legendre polynomials with the following example. 


(15.38) 


Example 15.4 

Find the potential difference (voltage) v at a point P developed by a nearby dipole in terms of 
the distance between the point P and the dipole, and the angle which point P makes with the 
center of the dipole. 


* A dipole is a pair of electric charges or magnetic poles, of equal magnitude but of opposite sign or polarity, separated by a 
small distance. Alternately, a dipole is an antenna, usually fed from the center, consisting of two equal rods extending out¬ 
ward in a straight line. 
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Solution: 

Let the charges q and -q of the dipole be a distance 2d apart with the origin 0 as the midpoint as 
shown in Figure 15.3. 

f P 



Figure 15.3. Figure for Example 15.4 

Let the potential at point P be V P . From electromagnetic field textbooks we find that 


V P = 


-a-(!_r) 

4ti 8 0 Vr 2 T X J 


(15.39) 


where s 0 is the permittivity of the vacuum. For simplicity, we will denote the quantity 1/(4tis 0 ) 
as k and thus we rewrite (15.39) as 


Next, we need to express r, and r 2 in terms or d and r. By the law of cosines, 
r, = Vd 2 + r 2 -2drcos(180° - 0) = Jd 2 + r 2 + 2drcos0 


and 


r 2 = Jd 2 + r 2 -2drcos0 
Dividing both sides of (15.42) by r, we obtain 


— = 0 - + 1 -* 


(15.40) 

(15.41) 

(15.42) 

(15.43) 


* Permittivity is a measure of the ability of a material to resist the formation of an electric field within it. 
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r- 1 = A^ + i_^£osWj (15.44) 

In all practical applications, the point P is sufficiently far from the origin; thus, we assume that 
r > d. Now, we want to relate the terms inside the parentheses of (15.44), to a Legendre polyno¬ 
mial. We do this by expressing these terms in the form of the generating function of (15.38). 

We let x = cos0, and y = d/r ; then, by substitution into (15.44) we obtain 

( 2 V 1/2 x 

d_ + l_2dcose = ( 1 -2xy + yV /2 = V P„ ( x)y” (15.45) 

V r r ) n = 0 

We recall that (15.45) holds only if |x| < 1 and |y| < 1. This requirement is satisfied since x and y, 
as defined, are both less than unity. 

To find a similar expression for rj 1 , we simply replace x with -x in (15.45), and thus 

( 1 +2xy + y 2 )“ 1/2 = jr P n (-x)y n (15.46) 

n = 0 

By substitution of (15.45) and (15.46) into (15.40), we obtain 

V P = ^ E [ p n( x )y n - p n(-x)y n ] (15.47) 

1 n = 0 

Since x = cos0, and y = d/r, we can express (15.47) as 

V p = ^3 jr [P n (cos0)-P n (-cos0)](-) n (15.48) 

1 n = 0 

However, if n is even in (15.48), P n (-cos0) = P n (cos0), and therefore, all even powers vanish. 
But when n is odd, P n (-cos0) = -P n (cos0)and the odd powers in (15.48) are duplicated. Then, 

v p = X 2p 2 „+ ifcose)^) 2 °*' (15.49) 

n = 0 

and for r » d, (15.49) can be approximated as 

Vp ~ “~ p i( c °s0)(“ ) = ^cos©* (15.50) 
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The term 2dq is the magnitude of the so-called dipole moment. It is a vector directed from the 
negative charge towards the positive charge. It is denoted with the letter p, that is, 

p = 2qd (15.51) 


The relation of (15.50) can, of course, be derived without the use of Legendre polynomials as fol¬ 
lows: 


For r » d, the distances r,, r, and r 2 can be approximated by parallel lines as shown in Figure 
15.4. Then, the negative and positive charges look like a single point charge, and using (15.40) 
we obtain 


v ^(r-f) = rT< r - r .> = - 

r 2 r l ' r l r 2 r 


2kqd 

—— Cl 


(15.52) 


We observe that (15.52) is the same as (15.50). 


. P 



Figure 15.4. Derivation of the voltage developed by a dipole 

Another interesting relation that can be used to find the Legendre polynomial series of a function 
f(x) for |x| < 1, is 


B n = ~ f ( x ) P n( x ) dx 


(15.53) 


* Here, we have used the identity Pj(cosG) = cosG. This will be seen shortly in (15.57) when we discuss the trigonometric 
form of the Legendre polynomials. 
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Then, a function f(x) can be expanded as 


f(x) = B 0 P 0 (x) + B 1 P 1 (x) + B 2 P 2 (x) + ... + B n P n (x) = £B n P n (x) 


The example below illustrates how this relation is being used. 


(15.54) 


Example 15.5 

Compute the Legendre polynomial series representing the waveform of Figure 15.5. 


f(x)' 

1 


-1 


; 

0 

1 X 

l- 

-1 



Figure 15.5. Waveform for Example 15.5 


Solution: 

We will first compute the coefficients B n from (15.53); then, we will substitute these into (15.54). 
We will also use (15.34) for the polynomials of P n (x). 

For this example, 


Bo = iJ_,(- 1 >-i- dx+ ^ 0 i-i- dx = -?i-. + ?i; = -H = ° 

3r° 3 r 1 3 ' 5 i 0 3 ?i 1 33 3 

B i = 2l_,( _1 )• x -dx + 1-x-dx = --x L, + ^x \ 0 = - + - = - 

B 2 = |J (- 1 > • |c 3x2 - 1 > dx +1 1 - | (3x2 - 1 > dx = o 


B 3 = \\ (-l)-|(5x 3 -3x)dx + || 1 -|(5x 3 -3x)dx = -Z 


E 4 = lf (-1) • ^(35x 4 - 30x 2 + 3)dx +1J' 1 - ^(35x 4 - 30x 2 + 3) = ( 
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B 5 = -y-J ^(63x 5 - 70x 3 + 15x)dx + yJ ^(63x 5 - 70x 3 + 15x) = || 
and so on. Therefore, using (15.54) and (15.34) we obtain 
f(x) = |p 1 (x)-|p 3 (x) + ||p 5 (x) 

- §x -- l • |(5x 3 - 3x) + ■ ^(63x 5 - 70x 3 + 15x) 

= |x - Y^(5 x 3 - 3x ) + • ( 63x5 - 70x3 + 15x ) 

525 525 3 693 5 

128 X 64 X + 128 X 


We observe that the waveform of f(x) is an odd function and, as we found above, its expansion 
contains only odd Legendre polynomials. 

In many applications, the algebraic form of the Legendre polynomials is usually the most useful. 
However, there are times when we want to express the polynomials in terms trigonometric func¬ 
tions, as we did in Example 15.4. Also, the trigonometric forms are most convenient with the 
cylindrical and spherical coordinate systems. It is shown in advanced mathematics textbooks that 


P n cos0 = 


1 - 3 • ... • (2n- 1) 
2-4- ... • 2n 


1 • 3 • • (2n- 3) 

2-4- ... -(2n-2) 


2cos(n- 2)0 


1 ■ 3 1 -3- ... ■ (2n - 5) 
2-4'2-4- ... ■ (2n-4) 


2cos(n - 4)0 + ... 


(15.56) 


From (15.56) we obtain the first 6 Legendre polynomials in trigonometric form listed below. 


P o cos0 = 1 
PjCOS© = COS0 

3cos20 + 1 


P 2 cos0 = : 


P 3 cos0 = 


5 cos 30 + 3cos0 


35cos40 + 2Ocos20 + 9 


63cos50 + 35cos30 + 3Ocos0 


(15.57) 


The Legendre polynomials in algebraic form, satisfy the orthogonality principle when m^n as 
indicated by the following integral. 
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[ P m (x)P n (x)dx = 
•Li 



m = n 


(15.58) 


Similarly, the Legendre polynomials in trigonometric form satisfy the orthogonality principle when 
m * n as indicated by the following integral. 


f P m (cos0)P n (cose)sin0de = 

J o 


0 

2 

2n+ 1 


(15.59) 


We must remember that all the Legendre polynomials we have discussed thus far are referred to as 
surface zonal harmonics, and math tables include values of these as computed from Rodrigues’ for¬ 
mula of (15.35). 

There is another class of Legendre functions which are solutions of the differential equation 


n(n+ 1)-- 


(15.60) 


and this is referred to as the associated Legendre differential equation. We observe that if m = 0 , 
(15.60) reduces to (15.27). 

The general solution of (15.60) is 

y = CjP^W + CjQ^x) (15.61) 


where C, and C 2 are arbitrary constants. The functions P™(x) and Q™(x) are referred to as asso¬ 
ciated Legendre functions of the first and second kind respectively. These are evaluated from 


P n m (x) = 

(-I)" 

“(1 -x 2 

m/2 d m 
) • ^P n (x) 

dx 

(15.62) 

Q n » = 

(-1) 1 

“(1 -X 2 

A’■%!,,(*) 

dx 

(15.63) 


Relations (15.62) and (15.63) are also known as spherical harmonics. 

We will restrict our subsequent discussion to the associated Legendre functions of the first kind, 
that is, the polynomials P “(x). 
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At present, Excel does not have any functions related to Legendre polynomials. MATLAB pro¬ 
vides the legendre(n,x) function that computes the associated Legendre functions of the first 
kind of degree n, and order m = 0, 1, 2, ..n evaluated for each element of x. 


Example 15.6 


Lind the following associated Legendre functions and evaluate as indicated. 



Solution: 

Lor this example, we use the relation (15.62), that is, 



dx 1 

and the appropriate relations of (15.34). Lor this example, 



= -(l-x 2 ) 1/2 (3x) = -1.2990 


Lor m = 0 in (15.62), we obtain 



As stated above, the MATLAB legendre(n,x) function computes the associated Legendre 
functions of the first kind of degree n and order m = 0, 1, 2, ..., n evaluated for each element 
of x. Here, n = 2 and thus MATLAB will return a matrix whose rows correspond to the val¬ 
ues of m = 0, m = 1, and m = 2, for the first, second, and third rows respectively. 

Check with MATLAB: 

disp('The values for m = 0, m = 1 and m = 2 are:'); legendre(2,0.5) 

The values for m = 0, m = 1 and m = 2 are: 
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ans = 

-0.1250 

-1.2990 

2.2500 

or more elegantly, 

m=0:2; y=zeros(3,2); y(:,1)=m'; y(:,2)=legendre(2,0.5); 
fprintf('\n'); fprintf('m\t Legendre \n'); fprintf('%2.0f\t %7.4f \n',y') 

m Legendre 
0 -0.1250 

1 -1.2990 

2 2.2500 


21 22 2/2 d 

P 3 2 (x) =(-1) 2 (1-x 2 ) -V 3 (x) 

IX- U.5 dx~ 


dx 2V 2 J I 




- (1 _ x )(15x)| = -5.6250 


Here, n = 3, and thus MATLAB will display a matrix whose rows correspond to the values of 
m = 0,m = 1, m = 2, and m = 3, for the first, second, third and fourth rows respectively. 
Check with MATLAB: 

m=0:3; y=zeros(4,2); y(:,1)=m'; y(:,2)=legendre(3,-0.5); 
fprintf('\n'); fprintf('m\t Legendre \n'); fprintf('%2.0f\t %7.4f \n',y') 

m Legendre 
0 0.4375 

1 -0.3248 

2 -5.6250 

3 -9.7428 


P 2 (x) 




2A/2 d" 2 

= -(1-x ) — (3x -1) 

, dx 3 


and since the third derivative of 3x 2 - 1 is zero, it follows that P 3 (x) = 0. 


In general, if m > n, then P™(x) = 0. 
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15.3 Laguerre Polynomials 

Another class of polynomials that satisfy the orthogonality principle, are the Laguerre polynomials 
L n (x); these are solutions of the differential equation 

x^+(l-x)^ + ny = 0 (15.64) 

dx “ x 

These polynomials are computed with the Rodrigues’ formula 

L n (x) = e x —(x n e" x ) (15.65) 

dx a 

The orthogonality principle for these polynomials states that 

f e” x L m (x)L n (x)dx = 0 (15.66) 

J o 


Example 15.7 

Compute the Laguerre polynomials 

a. L 0 (x) b.Lj(x) c. L 2 (x) d. L 3 (x) 

Solution: 

Using Rodrigues’s formula of (15.65), we obtain 

,o 

T / \ X d , 0 -X x X -X 0 . 

L 0 (x) = e —-(x e) = ee = e = 1 
dx 

L,(x) = e x —(xe x ) = e x (e x -xe x ) = 1 - x 
dx 

2 (15.67) 

L 2 (x) = e x -^-(x 2 e _x ) = e x e _x (2 - 4x + x 2 ) = 2 - 4x + x 2 
dx 2 

L 3 (x) = e x —(x 3 e’ x ) = 6-18x + 9x 2 -x 3 
dx 3 

The differentiation of the last two polynomials in (15.67) was performed with MATLAB as fol¬ 
lows: 

syms x y z 

y=x A 2*exp(-x); z=diff(y,2);% Differentiate y twice with respect to x 
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L2x=exp(x)*z; simplify(L2x) 

ans = 

2 -4 *x+x / '2 

syms x y z w ; y=x A 3*exp(-x); z=diff(y,2);% Differentiate y twice 
% we cannot differentiate three times at once 
w=diff(z);% Differentiate one more time 
L3x=exp(x)*w; simplify(L3x) 

ans = 

6-18*x+9*x A 2-x A 3 


15.4 Chebyshev Polynomials 

The Chebyshev polynomials are solutions of the differential equations 



(15.68) 


and 


(1-x 2 )^—^-3x^ + n(n + 2)y = 0 
dx 2 dx 


(15.69) 


The solutions of (15.68) are referred to as Chebyshev polynomiak of the first kind and are denoted as 
y = T n (x). The solutions of (15.69) are the Chebyshev polynomials of the second kind; these are 
denoted as y = U n (x). Both kinds comprise a set of orthogonal functions. 

We will restrict our discussion to the T n (x) polynomials. We will plot some of these later in this 
section. 

Two interesting properties of the T n (x) polynomials are: 

1. They exhibit equiripple amplitute characteristics over the range -1 < x < 1, that is, within this 
range, they oscillate with the same ripple. This property is the basis for the Chebyshev approx¬ 
imation in the design of Chebyshev type electric filters. 

2. For |x| > 1 they increase or decrease more rapidly than any other polynomial of order n. 


* Some books use the notation C k (x) for these polynomials. However, another class of orthogonal functions known as 
Genenbauer or Ultraspherical functions use the notation C„ a \x) and for this reason, we will avoid notation C k (x) for 
the Chebyshev polynomials. 
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These polynomials are tabulated in reference books which contain mathematical functions. A 
good reference is the Handbook of Mathematical Functions, Dover Publications. They can also be 
derived from the following relations. 


T n (x) = cosfncos 'x) for |x] < 1 
T n (x) = cosh(ncosh _1 x) for |x| > 1 


(15.70) 

(15.71) 


Using (15.70) or (15.71), we can express T n (x) as polynomials in powers of x. Some are shown in 
Table 15.2. 

TABLE 15.2 Chebyshev polynomials expressed in powers of x 


n 

T n (x) 

0 

1 

1 

x 

2 

2x 2 - 1 

3 

4x 3 -3x 

4 

8x 4 - 8x 2 + 1 

5 

16x 5 - 20x 3 + 5x 

6 

32x 6 -48x 4 + 18x 2 - 1 


To show that the relation of (15.70) can be expressed as a polynomial, we let 
x = cosy 

and 

T n (y) = cosny 

Next, in (15.73), we replace n with n + 1 and we obtain 

T n +i(y) = cos(n+l)y = cosnycosy- sinnysiny 
Similarly, replacing n with n - 1, we obtain 

T n -i(y) = cos(n-l)y = cosnycosy + sinnysiny 
Now, we add (15.74) with (15.75), and making use of (15.73) and (15.72), we obtain 
T n + l (y) + T n _ i (y) = 2cosnycosy = 2T n (y)x = 2xT n (y) 


(15.72) 

(15.73) 

(15.74) 

(15.75) 

(15.76) 
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or 

T n+1 (y) = 2xT n (y) - T n _ x (y) 
Then, we can replace y with x to obtain 


T n + 1 (x) = 2xT n (x)-T n _ 1 (x) 
Recurrence Relation 


(15.77) 


The polynomials in Table 15.2, can now be verified by using a combination of the above relations. 
Thus, for n = 0, (15.73) yields 

T 0 (y) = T 0 (x) = 1 (15.78) 

For n = 1, from (15.73) and (15.72), we obtain 

Tt(y) = Ti(x) = X (15.79) 

To derive the algebraic expressions corresponding to n = 2, 3, 4 and so on, we use the recurrence 
formula of (15.77). For instance, when n = 2, 


T 2 (x) = 2xT 1 (x)-T 0 (x) = 2x -1 


(15.80) 


and when n = 3 , 


T 3 (x) = 2xT 2 (x) - Tj(x) = 4x -2x-x = 4x -3x (15.81) 

Alternately, we can prove the first 3 entries of Table 15.2 with (15.70) by letting y = cos 'x. 
Thus, for n = 0 , 

T 0 (x) = cos(0 • cos _1 x) = cos(0 • y) = 1 

For n = 1, 

Tj(x) = cos(l • cos ! x) = cos(l ■ y) = cosy = x 

and for n = 2, 

T 2 (x) = cos(2 ■ cos J x) = cos(2 ■ y) = cos2y = 2cos 2 y- 1 

= 2cos 2 (cos" 1 x) -l=l\ . c os(cos -1 x) . cos(cos -1 x) 1 _ , 

Lx x J 

or 

T 2 (x) = 2x 2 - 1 

Relation (15.71) can be derived from (15.70) as follows: 

We recall that 
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and 

Then, 

and when |x| > 1 , 


cos a = coshja 


(15.82) 

(15.83) 

(15.84) 


cos x = -jcosh x (15.85) 

By substitution into (15.70), making use of (15.85), and that cosh(-t) = cosht, we obtain 


T n (x) = cos[n(-jcosh *x)] = cos(-jncosh 'x) = cosh(jnjcosh ! x) 

= cosh[j(-jncosh -1 x)] = cosh(ncosh _1 x) 
and this is the same as (15.71). 

We can also use MATLAB to convert (15.70) and (15.71) to polynomials. For example, if n = 3 , 
syms x; 

expand(cos(3*acos(x))), expand(cosh(3*acosh(x))) 

ans = 

4*x / '3-3*x 


ans = 

4*x^3-3*x 

The MATLAB script below plots the T n (x) for n = 0 through n = 6. 

% Chebyshev polynomials 

% 

x=—1.2:0.01:1.2; Tnx0=cos(0*acos(x)); 

Tnx1=cos(1*acos(x)); Tnx2=cos(2*acos(x)); Tnx3=cos(3*acos(x)); Tnx4=cos(4*acos(x)); 

Tnx5=cos(5*acos(x)); Tnx6=cos(6*acos(x)); 

plot(x, TnxO, x, Tnxl, x, Tnx2, x, Tnx3, x, Tnx4, x, Tnx5, x, Tnx6);.... 

axis([-1.2 1.2 -1.5 1.5]); grid; title('Chebyshev Polynomials of the First Kind 1 ); 

xlabel('x'); ylabel('Tn(x)') 

% We could have used the gtext function to label the curves but it is easier with the Figure text 
% tool 


* Let cosa = coshja = v; then a = cos V, ja = cosh 'v, jcos 'v = cosh *v and (15.85) follows. 
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Figure 15.6 shows the plot of the Chebyshev polynomials of the first kind T n (x) for n = 0 
through n = 6. 



Figure 15.6. Plot of Chebyshev polynomials with MATLAB 

As mentioned earlier, Chebyshev polynomials, among other applications, are used in the design of 
electric filters. The filters are described in terms of rational polynomials that approximate the 
behavior of ideal filters. The basic Chebyshev low-pass filter approximation is defined as 

A 2 (o3) = -- (15.86) 

1 + s 2 T n (co/co c ) 

where m is the operating radian frequency, oo c is the cutoff frequency, and a and s are other 
parameters that are used to specify the order and type of the electric filter. 

For example, if we want to design a second order Chebyshev low-pass filter, we use the Cheby¬ 
shev polynomial 

T 2 (x) = 2x 2 - 1 

and (15.86) becomes 

A 2 (co) = -----T- (15.87) 

1 +s 2 [2(cdAo c ) 2 -1] 


* For a thorough discussion on the design of analog and digital filters refer to Signals and systems with MATLAB Applica¬ 
tions, Orchard Publications, ISBN 0-9744239-9-8. 
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Summary 


15.5 Summary 

• Differential equations with variable coefficients cannot be solved in terms of familiar functions 
as those which we encountered in ordinary differential equations with constant coefficients. 
The usual procedure is to derive solutions in the form of infinite series, and the most common 
are the Method of Frobenius and the Method of Picard. 

• Bessel functions are solutions of the differential equation 



where n can be any number, positive or negative integer, fractional, or even a complex num¬ 
ber. The general solution depends on the value of n. 


• The series 



where n is any positive real number or zero is referred to as Bessel function of order n. 
• The series 



k = 0 

is referred to as the Bessel function of negative order n. 
• For n = 0, 1 and 2 the series reduce to 


J 0 (x) = 1 - 


2 4 



X 


o 2 4 2 

2 - ( 1 !) 2 ■ ( 2 !) 


2 8 - (4!) 2 


5 


7 


9 



2 2 3 - 1! - 2! 2 5 - 2! - 3! 2 7 - 3! - 4! 2 9 - 4! - 5! 



• Two more useful relations are 
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A{xJj(x)} = xJ 0 (x) 

• Values of J n (x) can be calculated using the appropriate series given above. They also can be 
found in math table books, and can also be found with the MATLAB besselj(n,x) function or 
the Excel BESSELJ(x.n) function. 

• The Bessel functions 

Ji /2 (x) = /—sinx and J r _ 1/2 dx) = /— cosx 
A/tix y J y 7TX 

are known as half-order Bessel functions. 

• Besides the above functions known as Bessel functions of the first kind, other Bessel functions, 
denoted as Y n (x) and referred to as Bessel functions of the second kind, or Weber functions, 
or Neumann functions exist. Also, certain differential equations resemble the Bessel equation, 
and thus their solutions are called Modified Bessel functions, or Hankel functions. 

• If n is not an integer, J n (x) and J_ n (x) are linearly independent; for this case, the general solu¬ 
tion of the Bessel equation is 

y = AJ n (x) + BJ_ n (x) 
n*0, 1,2,3, ... 

• If a and b are distinct roots of J 0 (x) = 0, J 0 (a) = 0 and J 0 (b) = 0 , then, 

f xJ 0 (ax)J 0 (bx)dx = 0 

J o 

and thus we say that J 0 (ax) and J 0 (bx) are orthogonal in the interval 0 < x < 1. 

• The differential equation 

( i_ x 2 ) d|_ 2x ^ + „(„ + i )y = 0 

dx 2 dx 

where n is a constant, is known as Legendre’s equation. 

• The infinite series solution of the Legendre functions, denoted as Q n (x), is referred to as Leg¬ 
endre functions of the second kind. 
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The Legendre polynomials are defined as 

P„(x) = f (-T-Pn-Zk). 

k = o 2 n k!(n - k)!(n-2k)! 

where N = § for n = even and N = for n - odd 

2 2 


and the first 6 Legendre polynomials are 
P 0 (x) = 1 
P 2 (x) = |(3x 2 - 1) 


Pi(x) = x 


The relation 


P ( x ) = 


is known as Rodrigues’ formula, and offers another method of expressing the Legendre polyno¬ 
mials. 

The Legendre polynomial series of a function f(x) for |x| < 1 , is 

B n = ~ f ( x ) P n( x ) dx 

and with this relation we can find a polynomial f (x) defined as 

f(x) = B 0 P 0 (x) + BjPjfx) + B 2 P 2 (x) + ... + B n P n (x) = ]TB n P n (x) 

n = 0 

The trigonometric form of the Legendre polynomials is 

„ „ 1 -3 ■ ....(2n-l)„ „ 1 1-3 • ...-(2n-3), , 

n 2-4- ... -2n 2 2-4- ... -(2n-2) v 7 

and the first 6 Legendre polynomials in trigonometric form listed below. 
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P o cos0 = 1 

PjCosG = cos0 

D „ 3cos20 + l 

P,cos0 - - 

4 

P 3 COS0 = 5cos30 + 3cos0 

- 35cos40 + 2Ocos20 + 9 


P 5 cos0 = 


63 cos50 + 35cos30 + 3Ocos0 


The Legendre polynomials in algebraic form, satisfy the orthogonality principle when m^n as 
indicated by the integral 


J P m (x)P n (x)dx = 


0 

2 

2n+ 1 


• The Legendre polynomials in trigonometric form satisfy the orthogonality principle when 
m#n as indicated by the integral 


f P m (cos0)P n (cose)sin0de = 

J o 


0 

2 

2n+ 1 


m*n 

m = n 


• The differential equation 

< 1 - x 2 , ^- 2 x l + [ n(n+ 1 >-yJ] y = 0 

is referred to as the associated Legendre differential equation. The general solution of this 
equation is 

y = C,P n m (x) + C 2 Q n m (x) 

where Cj and C 2 are arbitrary constants. The functions P™(x) and Q™(x) are referred to as 
associated Legendre functions of the first and second kind respectively. These functions, also 
known as spherical harmonics, are evaluated from the relations 

P“(x) = (-l) m (l-x 2 ) m/2 --^P„(x) 
dx 
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Summary 


m m2 m/2 H 

Q n m (x) = (-1) (l- x ) --^QnCx) 

dx 

The MATLAB legendre(n,x) function computes the associated Legendre functions of the 
first kind of degree n, and order m = 0, 1, 2, ..n evaluated for each element of x. 

The solutions of the differential equation 


x iL + (l-x)g + ny = 0 


are known as Laguerre polynomials and are denoted as L n (x). These polynomials are satisfy 
the orthogonality principle. They are computed with the Rodrigues’ formula 


dx 

The Chebyshev polynomials are solutions of the differential equations 

(i-x 2 A- x ^ +n y = o 


and 


(1 - x 2 )^4 - 3x^ + n(n + 2)y = 0 
dx 2 dx 


The solutions of the first differential equation are referred to as Chebyshev polynomials of the 
first kind and are denoted as y = T n (x). The solutions of the second are the Chebyshev poly¬ 
nomials of the second kind; these are denoted as y = U n (x). Both kinds comprise a set of 
orthogonal functions. 

• The T n (x) polynomials are derived from the relations 


T n (x) = cosfncos *x) for |x| < 1 


T n (x) = coshfncosh 'x) for |x| > 1 

These polynomials exhibit equiripple amplitute characteristics over the range -1 < x < 1, that 
is, within this range, they oscillate with the same ripple as shown in Figure 15.6. This property 
is the basis for the Chebyshev approximation in the design of Chebyshev type electric filters. 
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15.6 Exercises 

1. Use the appropriate series of the Bessel functions J n (x) to compute the following values using 
the first 4 terms of the series and check your answers with MATLAB or Excel. 

a. J 0 (3) b. J,(2) c. J 1 / 2 (n/ 6) d. J_ 1/2 (jt/3) 

2. Use the appropriate Legendre polynomials P n (x) or P n m (x) and Rodrigues’s formulas to com¬ 
pute the following, and check your answers with MATLAB. 

P l< X >L-0.5 b - P 2< X )| x , 0 . V 5 C. P 3< X )|„ 0 J5 

d . P ^( x)|„ 05 e . P 2 3 ( x )|„_ 05 f . P 3 2 ( x )|„ 025 

3. Compute the Legendre polynomial g(x) representing the waveform f(x) of the figure below. 
The first 5 terms of P n (x), i.e., P 0 (x) through P 4 (x) will be sufficient. Then, use MATLAB or 
Excel to plot g(x) and compare with f(x). 


1 

f(x) 


-1 

1 X 
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15.7 Solutions to End-of-Chapter Exercises 
1 . 


J 0 ( x ) = 1 - - 


J i( x ) = f- 


8 ^ 32 128 


2 2 2 • 4 2 2 • 4 2 • 6 2 Z • 4 Z • 6 Z 


J l/2 ( x ) 



J-2— sin( 7I /6) = ^ = — = 0.5513 

yn(n/6) n 2 2n n 


d. 


J 1/2 ( X ) 



I 2 / /a ., V6 1 J6 

-cos(ti/3) = — • - = — 

V7i(ti/3) n 2 2n 


= 0.3898 


Check with MATLAB: 

besselj(0,3), besselj(1,2), besselj(0.5,pi/6), besselj(-0.5,pi/3) 

ans = 

-0.2601 


ans = 

0.5767 


ans = 

0.5513 


ans = 

0.3898 

We observe that the first value returned by MATLAB above is significantly different from 
that we obtained from the series. This is because our computation was based on the first 4 
terms of the series. Had we taken also the fifth term our answer would have been -0.2563 and 
this is much closer to the value obtained with MATLAB. 
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We will use the relations of (15.34) and (15.62). They are repeated below for convenience. 


P 0 (x) = 1 


Pi(x) = x 


P 2 (x) = ±(3x 2 -l) P 3 (x) = ±(5x 3 -3x) 


P n m (x) = (-l) m (l-x 2 ) m/2 -^P n (x) 
dx 


P l( X )|x = 0.5 = X = 05 


p 2( x )lx = 0.75 = P* - 1) = 0.5(3 x (0.75) - 1) = 0.3438 


p 3 ( x )| x = 0.2 5 = P x -3x) = 0.5(5 X (0.25) -3 x0.25) = -0.3359 


2 2/2 d' 


Pf(x)| x = 0 . 5 = (-1) (1-x ) ‘^Pi(x) = (l-x z )-^ 1 (x) =0 


We recall that if m > n, then P“(x) = 0 . 

P 2(x)| x = _ as = 0 

This is because m > n. In other words, 


-V 2 (x) = -^Uf 3 * 2 -!)!— 0 

dx 3 dx 3 l 2 1 


2 ( x ) | x = 0 25 = ( _1 ) 2 ( 1 “ x 2 ) 2/2 "^2 P 3( X )| = (1 -X 2 )-^{k5x 3 -3x)| 

dx L n ,< dx-[ z J 


= (l-0.25 2 )-^-j-(15x 2 -3)| = 0.4688(30x)| =3.5160 

2 dx lx = 0.25 
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Check with MATLAB: 


m=0:1; y=zeros(2,2); y(:,1)=m'; y(:,2)=legendre(1,0.5); 
fprintf('\n'); fprintf('m\t Legendre \n'); fprintf('%2.0f\t %7.4f \n',y') 

m Legendre 
0 0.5000 

1 -0.8660 


m=0:2; y=zeros(3,2); y(:,1)=m'; y(:,2)=legendre(2,0.75); 
fprintf('\n'); fprintf('m\t Legendre \n'); fprintf('%2.0f\t %7.4f \n',y') 

m Legendre 
0 0.3438 

1 -1.4882 

2 1.3125 


m=0:3; y=zeros(4,2); y(:,1)=m'; y(:,2)=legendre(3,0.25); 
fprintf('\n'); fprintf('m\t Legendre \n'); fprintf('%2.0f\t %7.4f \n',y') 

m Legendre 
0 -0.3359 

1 0.9985 

2 3.5156 

3 -13.6160 


m=0:1; y=zeros(2,2); y(:,1)=m'; y(:,2)=legendre(1,0.5); 
fprintf('\n'); fprintf('m\t Legendre \n'); fprintf('%2.0f\t %7.4f \n',y') 

m Legendre 
0 0.5000 

1 -0.8660 

Here, the legendre(n,x) function computes the associated Legendre functions of degree n 
and order m = 0, 1, n, evaluated for each element of x. For this example, m > n, that is, 
m = 2 and n = 1 and the statement m=0:2 is not accepted. For this reason we’ve used 

m=0:1. 


m=0:2; y=zeros(3,2); y(:,1)=m'; y(:,2)=legendre(2,-0.5); 
fprintf('\n'); fprintf('m\t Legendre \n'); fprintf('%2.0f\t %7.4f \n',y') 

As in (d) above m > n and MATLAB returns 
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m Legendre 
0 -0.1250 

1 1.2990 

2 2.2500 


f. 

m=0:3; y=zeros(4,2); y(:,1)=m'; y(:,2)=legendre(3,0.25); 
fprintf('\n'); fprintf('m\t Legendre \n'); fprintf('%2.0f\t %7.4f \n',y') 

m Legendre 
0 -0.3359 

1 0.9985 

2 3.5156 

3 -13.6160 

B „ = ^ Li | 1 i f(x)P n (x)dx 
For this exercise f(x) = 0 for -1 < x < 0 and thus 

B n = f ( x ) P n( x ) dx 

z J o 


Then, 


) = \\ x ' PoOO ' d* = | • 


|f | 3 


3 x_| _ 1 
2 


= il 0 x d <3x2 - 1)dx = H 0 (3x3 - x)dx = = 

Bj = ^ J o x '|( 5 x 3 - 3 x)dx - | j ^( 5 x 4 - 3 x 2 )dx = 

B 4 = x • ^( 35 x 4 - 30 x 2 + 3 )dx = ( 35 x 5 - 30 x 3 + 3 x)dx 

2J n ° 16J n 


_5_ 

16 

= 0 


9 ( 35x 6 30 x 4 | 3x 2 ^| 1 = _3_ 
16V 6 4 2 J\ 0 32 
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and by substitution into 

f(x) = B 0 P 0 (x) + B 1 P 1 (x) + B 2 P 2 (x) + ... +B n P n (x) = jTB n P n (x) 

n = 0 

we obtain 

f(x) = Ip o (x) + ip 1 (x) + ^P 2 (x) + 0- P 3 (x)-^P 4 (x) 

1,1 5 1,- 2 3 1,„, 4 2 

= 4 + 2 X+ 16 2 3x - 1} -32'8 (35X “ 3 ° X +3) 

= 1 | x , 15x 2 5 105x 4 { 90x 2 9 

4 2 32 32 256 256 256 

or 

f(x) = - 77(15 + 128x + 210x 2 - 105x 4 ) 

256 

we note that f(-l) = -8/256 and f(0) = 15/256. These values are close to zero. Also, 
f(l) = 248/256 and this value is close to unity. 

We plot f(x) with the MATLAB script below. 

x=0:0.01:1; fx=(15+128.*x+210.*x. A 2-105.*x. A 4)./256; plot(x,fx); xlabel(‘x’); ylabel(‘f(x)’); grid 
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Chapter 16 


Optimization Methods 


T his chapter introduces three methods for maximizing or minimizing some function in order 
to achieve the optimum solution. These methods are topics discussed in detail in a branch of 
mathematics called operations research and it is concerned with financial and engineering 
economic problems. Our intent here is to introduce these methods with the basic ideas. We will 
discuss linear programming, dynamic programming, and network analysis, and we will illustrate 
these with some simple but practical examples. 


16.1 Linear Programming 

In linear programming we seek to maximize or minimize a particular quantity, referred to as the 
objective, which is dependent on a finite number of variables. These variables may or may not be 
independent of each another, and in most cases are subject to certain conditions or limitations 
referred to as constraints. 


Example 16.1 

The ABC Semiconductor Corporation produces microprocessors (pPs) and memory (RAM) 
chips. The material types, A and B , required to manufacture the pPs and RAMs and the profits 
for each are shown in Table 16.1. 


TABLE 1 6 .1 Data for Example 16.1 



Parts of Material Types 

pPs 

RAMs (1000s) 

Semiconductor Material A 

3 

2 

Semiconductor Material B 

5 

10 

Profit 

$25.00 per unit 

$20.00 per 1000 


Due to limited supplies of silicon, phosphorus and boron, its product mix at times of high con¬ 
sumer demand, is subject to limited supplies. Thus, ABC Semiconductor can only buy 450 parts of 
Material A, and 1000 parts of Material B . This corporation needs to know what combination of 
pPs and RAMs will maximize the overall profit. 


* A linear program is one in which the variables form a linear combination,i.e., are linearly related. All other programs are 
considered non-linear. 
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Solution: 

Since with Material A we can produce 3 pPs and 2 RAMs, and with Material B 5 pPs and 
10 RAMs, the corporation is confronted with the following constraints: 


3x + 2y < 450 
5x + lOy < 1000 

We now can state the problem as 

Maximize z = 25 x pP + 20 x RAMs 

subject to the constraints 

3x + 2y < 450 
5x+ 10y< 1000 

Two additional constraints are x > 0, y > 0, and x and y must be integers. 


(16.1) 

(16.2) 


For this example, there are only two variables, x and y; therefore, a graphical solution is possible. 
We will solve this example graphically. 

The x and y intercept corresponding to the above equations is shown in the plot of Figure 16.1 
where the cross-hatched area indicates the feasible region. 



Figure 16.1. Plot of constraint lines for Example 16.1 

The equation of the straight line of the maximum profit is referred to as isoprofit line. This line will 
pass through one of the three corners denoted as a, b, and c. 


* The feasible region is the area which includes all points (x,y) satisfying all constrains. 
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The isoprofit line that we are interested is described by the equation 
z = 25 x pP + 20 X RAM = constant 
= 25x + 20y = C 

We can express this equation in y = mx + b form, that is, 


■ = - 1.25x + k 


(16.3) 


(16.4) 


where k is the y-intercept. Therefore, all possible isoprofit lines have the same slope, that is, are 
parallel to each another, and the highest isoprofit line passes through point b. 

The coordinates of point b in Figure 16.1 are found by simultaneous solution of 


3x + 2y = 450 
5x+ lOy = 1000 

Using MATLAB for the solution of (16.5) we obtain 
syms x y 

[x y]=solve(3*x+2*y-450, 5*x+10*y-1000) 

x = 

125 

y - 

75/2 


(16.5) 


Of course, these values must be integers, so we accept the values x = 125, and y = 37. Then, by 
substitution into (16.1), 

z max = 25 x 125 + 20 x 37 = $3865 (16.6) 


and the isoprofit line can be drawn from the equation 

25x + 20y = 3865 (16.7) 

by first letting x = 0, then, y = 0. Then, we obtain the points 


and 


3865 

20 


193.25 


This is shown as a dotted line on the plot of Figure 16.1. 
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It was possible to solve this problem graphically because it is relatively simple. In most cases, how¬ 
ever, we cannot obtain the solution by graphical methods and therefore, we must resort to alge¬ 
braic methods such as the simplex method. This and other methods are described in operations 
research textbooks. 

We can find the optimum solution to this type of problems with Excel’s Solver feature. The proce¬ 
dure is included in the spreadsheet of Figure 16.2 



A_1 

1 i 1 

1 c 1 

II D 

E 

F 

1 

Optimization - Maximum Profit for Example 16.1 




2 

1. Enter zeros in B12 and B13 

2. In B15 enter =25*B12+20*B13 


3 

3. In B17 enter =3*B12+2*B13 and in B18 =5*B12+10*B13 | 


4 

4. From the Tools drop menu select Solver. Use Add-Ins if necessary to add it. 

5 

5. On the Solver Parameters screen enter the following: 



6 

Set Target Cell: B15 






7 

Equal to: Max 






8 

By Changing Cells: B12 : B13 






9 

Click on Add and enter Constraints: 





10 

B12-Integer, Add B13=lnteger, Add B12>=0, Add B13>=0, 



11 

Add B17<=450, Add B18<=1000, OK, Solve 




12 

xfpPs)— 

124 





13 

y(RAMs)- 

38 





14 







15 

Maximum Profit^ 

$3,860 





16 







17 

Semiconductor Material A- 

448 





18 

Semiconductor Material B= 

1000 





19 







20 

Note: Contents of A12:A18 are typed-in for information only 




Figure 16.2. Spreadsheet for solution of Example 16.1 with Excel’s solver 


16.2 Dynamic Programming 

Dynamic Programming is based on R. Bellman’s Principle of Optimality which states that: 

An optimum policy has the property that whatever the initial state and the initial decisions are, 
the remaining decisions must constitute an optimum policy with regard to the state resulting from 
the first decision. 

Figure 16.3 represents a line graph, where the nodes a through h represent the states, and the 
choice of alternative paths when leaving a given state, is called a decision. The alternative paths 
are represented by the line segments ab, ac, bd, and so on. 
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Dynamic Programming 



Figure 16.3. Line graph for a typical dynamic programming example 


We assume that all segments are directed from left to right, and each has a value assigned to it 
which we will refer to as the cost. Thus, there is a cost associated with each segment, and it is usu¬ 
ally denoted with the letter J. For example, for the path a, c, f, and h, the cost is 

Jah = J.c + Jcf + Jfh 06 . 8 > 

The costs for the other possible paths are defined similarly. 

For the line graph of Figure 16.3, the objective is to go from state a to state h with minimum cost. 
Accordingly, we say that the optimum path policy for this line graph is 

J min = min {( J ac + J cf + J &)’ ( J ac + J ce + J eh)> ( 16 - 9 ) 

(■ J ab + J bd + J dh)’ (■ J ab + J bg + J gh) > 

Now, let us suppose that the initial state is a, and the initial decision has been made to go to state 
b. Then, the path from b to h must be selected optimally, if the entire path from a to h is to be 
optimum (minimum in this case). 

Let the minimum cost from state b to h be denoted as g b . Then, 

g b = min {( J bd + J dhX( J bg + J gh)} (16-10) 

Likewise, if the initial decision is to go from state a to c, the path from state c to h must be opti¬ 
mum, that is, 

g c = min{ (J cf + Jfb), (J ce + J eb )} (16.11) 

The optimum path policy of (16.9) can now be expressed in terms of (16.10) and (16.11) as 

g a = J min = min {( J ab + Sb)’( J ac + g c )^ (16.12) 

This relation indicates that to obtain the minimum cost we must minimize: 

1. The part which is related to the present decision, in this case, costs J ab and J ac . 
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2. The part which represents the minimum value of all future costs starting with the state which 
results from the first decision. 


Example 16.2 

Find the minimum cost route from state a to state m for the line graph of Figure 16.4. The line 
segments are directed from left to right and the costs are indicated beside each line segment. 


d 



Solution: 

We observe that at states h, k, d, and f have no alternative paths since the lines are directed 
from left to right. Therefore, we make the first decision at state e . Then, 


g e = min{(3+g h ), (5 + g k )} = min{(3 + 5), (5 + 4)} = 8 
(e —> h —> m) 

Next, we make decisions at states b and c. 


(16.13) 


g b = min{(9 + g d ),(6 + g e )} = min{(9 + 6 ), (6 + 8 )} = 14 
(b—> e) 

g c = min{(4 + g e ),(6 + g f )} = min{(4 + 8 ), (6 + 8 )} = 12 
(c —» e) 

The final decision is at state a and thus 


(16.14) 

(16.15) 


g a = min{(5 + g b ),(3 + g c )} = min{(5 + 14), (3 + 12)} = 15 
(a—»c) 


(16.16) 
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Therefore, the minimum cost is 15 and it is achieved through path a—>c—>e—>h—»m,as shown 
in Figure 16.5 

d 



Figure 16.5. Line graph showing the minimum cost for Example 16.2 


Example 16.3 

On the line graph of Figure 16.6, node A represents an airport in New York City and nodes B 
through L several airports throughout Europe and Asia. All flights originate at A and fly east¬ 
ward. A salesman must leave New York City and be in one of the airports H, J, K, or L at the 
shortest possible time. The encircled numbers represent waiting times in hours at each airport. 
The numbers in squares show the hours he must travel by an automobile to reach his destination, 
and the numbers beside the line segments indicated the flight times, also in hours. Which airport 
should he choose ( H, J, K, or L ) to minimize his total travel time, and in how many hours after 
departure from A will he reach his destination? 
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Solution: 

The hours that the salesman must travel by automobile to reach his destination are 
g H = 3, gj = 2 , g K = 4 , and g L = 3 
The first decisions are made at D, E, and F. Then, 

g D = 2 + min{(5 + g H ), (4 + gj )} = 2 + min{(5 + 3), (4 + 2)} = 2 + 6 = 8 
D —> J 

g E = 4 + min{(3+ gj ),(4 + g K )} = 4 + min{(3 + 2), (4 + 4)} = 4 + 5 = 9 
E —» J 

g F = 3 + min {(6 + g K ), (7 + g L )} = 3 + min {(6 + 4), (7 + 3)} = 3 + 10 = 13 
F —» K or F->L 

The next decisions are made at B and C where we find that 

g B = 4 + min{(4 + g D ), (2 + g E )} = 4 + min{(4 + 8 ), (2 + 9)} = 4 + 11 = 15 
B->E 


(16.17) 

(16.18) 

(16.19) 

(16.20) 

(16.21) 


g c = 3 + min{(7 + g E ), (5 + g F )} = 3 + min{(7 + 9), (5 + 13)} = 3 + 16 = 19 
C->E 

The final decision is made at A, where we find 

g A = min {(8 + g B ), (6 + g c )} = min {(8 + 15), (6 + 19)} = 23 
A + B 

Therefore, the minimum cost (minimum time from departure to arrival at destination) is 23 
hours and it is achieved through path A—»B—»E—»J,as shown in Figure 16.7. 


(16.22) 


(16.23) 
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Example 16.4 

A start-up, high-technology company, has $4,000,000 to invest in three different products A, B 
and C. Investments in each product are assumed to be multiples of $1,000,000 and the company 
may allocate all the money to just one product or split it between these three products. The 
expected profits are shown in Table 16.2. 


TABLE 16.2 Amounts invested and return on investment for each product 


Investments 

Amount Invested 

0 I $1,000,000 1 $2,000,000 1 $3,000,000 | $4,000,000 


Return on Investment 

Product A 

0 

$2,000,000 

$5,000,000 

$6,000,000 

$7,000,000 

Product B 

0 

$1,000,000 

$3,000,000 

$6,000,000 

$7,000,000 

Product C 

0 

$1,000,000 

$4,000,000 

$5,000,000 

$8,000,000 


How should the money be allocated so that company will realize the maximum profit? 

Solution: 

This problem can also be solved with linear programming methods but we will use the so called 
tabular form of solution. Let 


Pi(x) i = A, B, C (16.24) 

denote the profits in millions from product i, when x units of dollars are invested in it. For sim¬ 
plicity, we express the profits in millions, and we enter these in Table 16.3. 


TABLE 16.3 Modified Table 16.2 


\ X 

pw\ 

0 

1 

2 

3 

4 

Pa( x ) 

0 

2 

5 

6 

7 

Pb( x ) 

0 

1 

3 

6 

7 

Pc( x ) 

0 

1 

4 

5 

8 


Our objective is to maximize the total profit z that represents the sum of the profits from each 
product, subject to the constraint that the amount invested does not exceed four million dollars. 
In other words is, we want to 

maximize z = p A (x) + p B (x) + p c (x) (16.25) 

subject to the constraint 
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X A + X B + X C - 4 

where x A , x B , and x c , are the amounts to be invested in products A, B and C respectively. 

The computations are done in three stages, one per product. We start by allocating units (mil¬ 
lions) to Product C (Stage C) , but since we do not know what units were allocated to the previous 
products A and B, we must consider all possibilities. 

We let Vj (u) denote the value of the optimum profit that can be achieved, where the subscript j 
indicates the number or stage assigned to the product, i.e., A for Product A, B for Product B, and 
C for Product C, and u represents the number of money units. Also, we let dj (u) be the decision 
that is being made to achieve the optimum value from vj (u). 

At Stage C, j = C, and u = 4, i.e., 4 millions assumed to be allocated to Product C. 

The possibilities that we allocate 0 or 1 or 2 or 3 or 4 units (millions) to Product C, and the 
corresponding returns are, from Table 16.3, 

v c (4) = max{p c (0), p c (l), p c (2), p c (3), p c (4)} = max{0, 1, 4, 5, 8} = 8 (16.27) 

with decision 

d c (4) = 8 (16.28) 

that is, the maximum appears in the fourth position since the left most is the zero position. 

The next possibility is that one unit was invested in either Product A or Product B, by a previous 
decision. In this case, do not have 4 units to invest in Product C; we have three or less. 

If we invest the remaining three units in Product C, the optimum value v c (3) is found from 

v c (3) = max{p c (0), p c (l), p c (2), p c (3)} = max{0, 1,4,5} = 5 (16.29) 

with decision 

d c (3) = 5 (16.30) 

If we have only two units left, and we invest them in Product C, we obtain the maximum from 

v c (2) = max{p c (0), p c (l), p c (2)} = max{0, 1,4} = 4 (16.31) 

with decision 

d c (2) = 4 (16.32) 

With only one unit left to invest, we have 

v c (l) = max{p c (0), p c (l)} = max{0, 1} = 1 (16.33) 
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(16.34) 

(16.35) 

(16.36) 



u 

0 

1 

2 

3 

4 

Stage 

C 

v c (u) 

0 

1 

4 

5 

8 

d c (u) 

0 

1 

2 

3 

4 

Stage 

B 

v B (u) 






d B (u) 






Stage 

A 

v A (u) 






d A (u) 







with decision 

d c (l) = 1 

Finally, with no units left to invest in Product C, 

v c (0) = max{p c (0)} = max{0} = 0 

with decision 

d c (0) = 0 

With these values, we construct Table 16.4. 

TABLE 16.4 Optimum profit and decisions made for Stage C 


Next, we consider Stage B, and since we do not know what units were allocated to Product A 
(Stage A), again we must consider all possibilities. 

With j = B and u = 4, 3, 2, 1 and 0, we have 

v b (4) = max{p B (0) + v c (4-0),p B (l) + v c (4-l),p B (2) (16.37) 

+v c (4 - 2), p B (3) + v c (4 - 3), p B (4) + v c (4 - 4)} 

This expression says that if zero units were invested in Product B, it is possible that all four units 
were invested in Product C, or if one unit was invested in Product B, it is possible that 3 units were 
invested in Product C, and so on. Inserting the appropriate values, we obtain 

v b (4) = max{0 + 8 , 1 + 5, 3 + 4, 6 + 1, 7 + 0} = 8 (16.38) 

with decision 

d B (4) = 0 (16.39) 

since the maximum value is the zero position term. 
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Using a similar reasoning, we have 

v B (3) = max{p B (0) + v c (3-0),p B (l) + v c (3-l),p B (2) 
+v c (3-2), Pb (3) + v c (3 - 3)} 
or 

v b (3) = max{0 + 5, 1+4, 3+ 1,6 + 0} = 6 
d B (3) = 3 

V B ( 2 ) = max{p B ( 0 ) + v c ( 2 - 0 ),p B (l) + v c ( 2 -l),p B ( 2 )+v c ( 2 - 2 )} 
v B (2)= max{0 + 4, 1 + 1, 3 + 0} = 4 


with decision 
Also, 


with decision 


with decision 


d B ( 2 ) = 0 

v B (l) = max{p B ( 0 ) + v c (l- 0 ),p B (l) + v c (l-l)} 
v B (l) = max {0 + 1 , 1 + 0 } = 1 


d B (l) = 0 

if we consider the zero position term, or 

d B (l) = 1 

if we consider the first position term. 

Also, 

v B ( 0 ) = max{p B ( 0 ) + v c (0 - 0 )} 


with decision 


v B ( 0 ) = max {0 + 0 } = 0 


d B ( 0 ) = 0 


(16.40) 

(16.41) 

(16.42) 

(16.43) 

(16.44) 

(16.45) 

(16.46) 

(16.47) 

(16.48) 

(16.49) 

(16.50) 

(16.51) 

(16.52) 


Next, we update the previous table to include the Stage B values. These are shown in Table 16.5. 
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TABLE 16.5 Updated table to include Stage B values 



u 

0 

1 

2 

3 

4 

Stage 

C 

v c( u ) 

0 

1 

4 

5 

8 

d c ( u ) 

0 

1 

2 

3 

4 

Stage 

B 

v B (u) 

0 

1 

4 

6 

8 

d B (u) 

0 

1 

0 

3 

0 

Stage 

A 

v A (u) 






d A (u) 







Finally, with j = A and u = 4 

v a (4) = max{p A (0) + v B (4-0),p A (l) + v B (4-l),p A (2) (16.53) 

+v b (4 - 2), Pa (3 ) + v b (4 - 3), Pa (4) + v b (4 - 4)} 
or 

v a (4) = max{0 + 8, 2 +6, 5 + 4, 6+1, 7 + 0} = 9 (16.54) 

with decision 

d A (4) = 2 (16.55) 

We complete the table by entering the values of Stage A in the last two rows as shown in Table 
16.6. The only entries are in the last column, and this is always the case since in deriving v A (4) 
and d A (4), all possibilities have been considered. 

Table 16.6 indicates that the maximum profit is realized with v A (4) = 9, that is, 9 units, and 
thus the maximum profit is $9,000,000. 

To determine the investment allocations to achieve this profit, we start with d A (4) = 2; this tells 
us that we should allocate 2 units to Product A, and the given table shows that 2 units 
($2,000,000) invested in this product will return $5,000,000. 


* Since this is the first stage, all 4 units can be allocated to the Product A or some of these can be allocated to Products B and 
C. Therefore, v A (4) considers all possibilities. 
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TABLE 16.6 Updated table to include values for all stages 



u 

0 

1 

2 

3 

4 

Stage 

C 

v c (u) 

0 

1 

4 

5 

8 

d c (u) 

0 

1 

2 

3 

4 

Stage 

B 

v B (u) 

0 

1 

4 

6 

8 

d B (u) 

0 

1 

0 

3 

0 

Stage 

A 

v A (u) 





9 

d A (u) 





2 


We now have two units left to invest in Products B and C. To find out where we should invest 
these units, we consider the decision at Stage B. Since two out of the four units have already been 
invested, we have d B (4 - 2 ) = d B ( 2 ), and by reference to the Table 16.6, we see that d 2 ( 2 ) = 0 . 
This tells us that we should not invest any units in Product B if only two units are left. The deci¬ 
sion at Stage C yields d c (4 - 0 - 2 ) = d c ( 2 ), and from Table 16.6, d c ( 2 ) = 2 . This indicates that 
we should invest the remaining two units to Product C where we can obtain a return of 
$ 4 , 000 , 000 . 

In summary, to obtain the maximum profit of $9,000,000, we should allocate: 

1. two units to Product A to earn $5,000,000 

2. zero units to Product B to earn $0 

3. two units to Product C to earn $4,000,000 

16.3 Network Analysis 

A network, as defined here, is a set of points referred to as nodes and a set of lines referred to as 
branches. Thus, Figure 16.8 is a network with 5 nodes A, B, C, D and E , and 6 branches AB , 
AC, AD, BD, BE, and CD. 



Figure 16.8. A typical network 
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Branches can be either directed (or oriented ), if they have a direction assigned to them, that is, 
one-way, or two-way. If no direction is assigned, they are considered to be two-way. Thus, the 
branches BD and BE in Figure 16.8, are directed but the others are not. 

A network is said to be connected, if there is a path (branch) connecting each pair of nodes. Thus, 
the network shown in Figure 16.8 is connected. 



Figure 16.9. A network which is connected 

The network of Figure 16.9 is also connected. However, the network of Figure 16.10 is not con¬ 
nected since the branch CD is removed. 



© 

Figure 16.10. A network which is not connected 

A tree is a connected network which has n branches and n + 1 nodes. For example, the network of 
Figure 16.11 is a tree network. 



Figure 16.11. A tree network 

Network analysis is a method that is used to solve minimum span problems. In such problems, we 
seek to find a tree which contains all nodes, and the sum of the costs (shortest total distance) is a 
minimum. 


Example 16.5 

Figure 16.12 represents a network for a project that requires telephone cable be installed to link 7 
towns. The towns are the nodes, the branches indicate possible paths, and the numbers beside the 
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branches, show the distance (not to scale) between towns in kilometers. Find the minimal span¬ 
ning tree, that is, the least amount of telephone cable required to link each town. 



Figure 16.12. Network for Example 16.5 


Solution: 

For convenience, we redraw the given network with dotted lines as shown in Figure 16.13, and 
we arbitrarily choose A as the starting node. 





5 \ / 2 


Figure 16.13. Network of Example 1 6.5 with no connections 


We observe that there are 3 branches associated with node A, i.e., AB, AD, and AC. By 
inspection, or from the expression 

min{AB = 3, AD = 5, AC = 4} = AB = 3 (16.56) 

we find that branch AB is the shortest. We accept this branch as the first branch of the mini¬ 
mum span tree and we draw a solid line from Node A to Node B as shown in Figure 16.14. 



Figure 16.14. Network of Example 16.5 with first connection 
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Next, we consider all branches associated with Nodes A and B . We find that the minimum of 
these is 

min{ AD = 5, AC = 4, BD = 5, BE = 8} = AC = 4 (16.57) 

and thus, AC is connected to the network as shown in Figure 16.15. 



Figure 16.15. Network of Example 16.5 with the second connection 

We continue by considering all branches associated with Nodes A, B and C, and we find that the 
shortest is 

min{AD = 5, BE = 8, BD = 5, CD = 4, CF = 10} = CD = 4 (16.58) 

and we add branch CD to the network shown in Figure 16.16. The dotted lines AD and BD have 
been removed since we no longer need to consider branch AD and BD, because Nodes B and D 
are already connected; otherwise, we will not have a tree network. 



Figure 16.16. Network of Example 16.5 with the third connection 

Next, considering all branches associated with Nodes B, C, and D and we find that the shortest 
is 

min{BE = 8, DE = 6, DG = 7, DF = 5, CF = 10} = DF = 5 (16.59) 

and the network now is connected as shown in Figure 16.17. 
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Figure 16.17. Network of Example 16.5 with the fourth connection 
Continuing, we obtain 

min {BE = 8, DE = 6, DG = 7} = DE = 6 
and the network is connected as shown in Figure 16.18 



Figure 16.18. Network of Example 16.5 with the fifth connection 
The last step is to determine the shortest branch to Node G. We find that 
min{EG = 5, DG = 7, FG = 2} = FG = 2 
and the complete minimum span tree is shown in Figure 16.19. 



(16.60) 


(16.61) 


Figure 16.19. Network of Example 16.5 with all connections 
Figure 16.19 shows that the minimum distance is3+4 + 4 + 6 + 5 + 2 = 24 kilometers. 
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16.4 Summary 

• Linear programming is a procedure we follow to maximize or minimize a particular quantity, 
referred to as the objective, which is dependent on a finite number of variables. These variables 
may or may not be independent of each another, and in most cases are subject to certain con¬ 
ditions or limitations referred to as constraints. 

• Dynamic Programming is based on R. Bellman’s Principle of Optimality which states that an 
optimum policy has the property that whatever the initial state and the initial decisions are, 
the remaining decisions must constitute an optimum policy with regard to the state resulting 
from the first decision. 

• A network, as defined in this chapter, is a set of points referred to as nodes and a set of lines 
referred to as branches. 

• A tree is a connected network which has n branches and n + 1 nodes. 

• Network analysis is a method that is used to solve minimum span problems. In such problems, we 
seek to find a tree which contains all nodes, and the sum of the costs (shortest total distance) is 
a minimum. 
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16.5 Exercises 

1. A large oil distributor can buy Grade A oil which contains 7% lead for $25.00 per barrel from 
one oil refinery company. He can also buy Grade B oil which contains 15% lead for $20.00 
per barrel from another oil refinery company. The Environmental Protection Agency (EPA) 
requires that all oil sold must not contain more than 10% lead. How many barrels of each 
grade of oil should he buy so that after mixing the two grades can minimize his cost while at 
the same time meeting EPA’s requirement? Solve this problem graphically and check your 
answers with Excel’s Solver. 

2. Use dynamic programming to find the minimum cost route from state a to state m for the line 
graph shown below. The line segments are directed from left to right and the costs are indi¬ 
cated beside each line segment. 



3. Repeat Example 16.3 for the line graph shown below. 
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4. A salesman has 4 hours available to visit 4 of his customers. He will earn the commissions 
shown on the table below for various visiting times. Compute the optimal allocation of time 
that he should spent with his customers so that he will maximize the sum of his commissions. 
Consider only integer number of visiting hours, and ignore travel time from customer to cus¬ 
tomer. The third row (zero hours) indicates the commission that he will receive if he just calls 
instead of visiting them. 


Visit Time 
(Hours) 

Customer 

1 

2 

3 

4 

0 

$20 

$40 

$40 

$80 

1 

$45 

$45 

$52 

$91 

2 

$65 

$57 

$62 

$95 

3 

$75 

$61 

$71 

$97 

4 

$83 

$69 

$78 

$98 
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16.6 Solutions to End-of-Chapter Exercises 

1. 

Let x be the number of barrels of Grade A oil and y be the number of barrels of Grade B oil. 
The objective is to minimize z = $25.00x + $20.00y or, for simplicity, 

z = 25x + 20y (1) 

We want to minimize (1) because it represents a cost, not a profit. 

Each barrel to be sold must not contain more than 10% lead and since Grade A contains 7% 
and Grade B 15 %, we must have 

0.07x + 0.15y < 0.10 (2) 

The oil of Grade A and Grade B used in each barrel to be sold must be equal to unity. Thus, 
x + y = 1 (3) 

Moreover, x and y cannot be negative numbers, therefore 
x>0 y>0 (4) 

The problem then can be stated as: 

Minimize (1) subject to the constraints of (2), (3), and (4). To determine the feasible region 
we plot (2) and (3) where the x and y crossings are found by first setting x = 0 and then 
y = 0 . Thus from (2), if x = 0 , y = 0.10/0.15 = 2/3 and if y = 0, x = 0.10/0.07 = 10/7. 
Likewise, from (3), if x = 0, y = 1, and if y = 0, x = 1. 



The isoprofit line passes through point b and its coordinates are found by simultaneous solu- 
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tion of (2) and (3). For convenience, we use the following MATLAB script: 
syms x y; [x,y]=solve(0.07*x+0.15*y-0.10, x+y-1) 

x = 

5/8 

Y = 

3/8 

Therefore, the distributor should buy Grade A oil at the ratio x = 5/8 and Grade B at the 
ratio y = 3/8 and by substitution into (1) 

z = 25x|+20x| = ^ = $23,125 

and this represents his cost per barrel. The isoprofit line is 
z = 25x + 20y = 23.125 

and the y -intercept is found by setting x in the equation above to zero and we find that 
y-intercept = 23.125/20 = 1.1563 

Check with Excel’s Solver: 



A | B | C 

D 

II E 

F 

1 

Optimization - Minimum Cost for Exercise 16.1 




2 

1. Enter zeros in B12 and B13 2. In B15 enter =25*B12+20*B13 


3 

3. In B17 enter =0.07*B12+0.15*B13 and in B18 =B12+B13 


4 

4. From the Tools drop menu select Solver. Use Add-Ins if necessary to add it. 

5 

5. On the Solver Parameters screen enter the following: 



6 

Set Target Cell: B15 






7 

Equal to: Min 






8 

By Changing Cells: B12:B13 






9 

Click on Add and enter Constraints: 





10 

B12>=0, Add B13>-0, 





11 

Add B17<=0.10, Add B18=1, OK, Solve 




12 

Grade A= 

0.625002 





13 

Grade B= 

0.374999 





14 







15 

Minimum Cost= 

$23,125 





16 







17 

Lead Content^ 

0.10 





18 

Grade A + Grade B= 

1.000001 





19 







20 

Note: Contents of A12:A18 are typed-in for information only 
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2 . 



Since the segments are directed from left to right, state e is the first node where a decision 
must be made and thus 

g e = min{3+ g h , 4 + g k } = min{3 + 4, 4 + 5} = 7 


Therefore, the best route from state e to state m passes through state h. Next, 
g b = min{8 + g d , 5 + g e } = min{8 + 5, 5 + 7} = 12 


and 


g c = min{4 + g e , 6 + g f } = min{4 + 7, 6 + 7} = 11 

Finally, 

g a = min{3 + g b , 5 + g c } = min{3 + 12, 5 + 11} = 15 
Thus, the best (shortest) path is a—>b—»e—>h—»m 



The numbers in circles represent the waiting time at these nodes. 
Last stage: g H = 2, gj = 2 , g K = 3, and g L = 4 
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Next stage to the left: 

g D = 1 + min{6 + g H , 4 + gj} = 1 + 6 = 7 from D to J 

g E = 3 + min{4 + g } , 5 + g K } = 3 + 6 = 9 from E to J 

g F = 4 + min{7 + g K , 6 + g L } = 4 + 10 = 14 from F to K or F to L 
Next to initial stage: 

g B = 5 + min{2 + g D , 4 + g E } = 5 + 9 = 14 from B to D 
g c = 2 + min{7 + g E , 1 +g F } = 2 + 15 = 17 from C to F 


Initial stage: 


g A = 0 + min{3 + g B , 5 + g c } = 17 from A to B 
Therefore, minimum path is from A —> B —> D —> J and the numerical minimum cost is 17. 


4. 



A 1 

1_5 

c 

II D 

II E 

F 

G 

H 

1 

Exercise 16.4 - Solution 







2 

A salesman has 4 hours available to visit 

of his customers. He will ear 

n the commissions shown on 

3 

the table below for various visiting times. Compute the optimal allocation of time that he should spend 

4 

with his customers so that he will maximize the sum of his commissions. Consider only integer number 

5 

of visiting hours, and ignore travel time from customer to customer. The third row (zero hours) 


6 

indicates the commission that he will receive if he just calls instead of visiting them. 



7 









8 

Visit Time 


Customer 






9 

(Hours) 

1 

2 

3 

4 




10 

0 

$20 

$40 

$40 

$80 




11 

1 

$45 

$45 

$52 

$91 




12 

2 

$65 

$57 

$62 

$95 




13 

3 

$75 

$61 

$71 

$97 




14 

4 

$83 

$69 

$78 

$98 




15 









16 

Solution 








17 

We will follow the same method as in Example 16.4 





18 






19 

It is convenient to rearrange the table as shown below. 





20 







continued on the next page 
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A 

B 

c 

D 

E 

F 

G 

H 

1 

21 




u 






22 

f(x) \ x 

0 

1 

2 

3 

4 




23 

f1(x) 

20 

45 

65 

75 

83 




24 

f2(x) 

40 

45 

57 

61 

69 




25 

f3( x ) 

40 

52 

62 

71 

78 




26 

f4(x) 

80 

91 

95 

97 

98 




27 










28 

m4(4)= 

max(B26,C26,D26,E26,F26 




98 

with d4(4)= 

4 

29 

m4(3)= 

max(B26,C26,D26,E26) 




97 

with d4(3)= 

3 

30 

m4(2)= 

max(B26,C26,D26) 




95 

with d4(2)= 

2 

31 

m4(1)= 

max(B26,C26) 




91 

with d4(1)= 

1 

32 

m4(1)= 

max(B26) 





80 

with d4(0)= 

0 

33 










34 

The values of m4(u) and d4(u) are entered in the table below. 





35 










36 




u 






37 


0 

1 

2 

3 

4 




38 

m4(u) 

80 

91 

95 

97 

98 




39 

d4(u) 

0 

1 

2 

3 

4 




40 

m3(u) 

120 

132 

143 

153 

162 




41 

d3(u) 

0 

1 

1 

2 

3 




42 

m2(u) 

160 

172 

183 

193 

202 




43 

d2(u) 

0 

0 

0 

0 

0 




44 

ml(u) 





248 




45 

dl(u) 





2 




46 










47 

Next, we compute the values of m3(u) and d3(u) 






48 

1 1 






49 

m3(4)=max[f3(0)+m4(4-0), f3(1)+m4(4-1), f3(2)+m4(4-2), f3(3)+m4(4-3), f3(4)+m4(4-4)] 



50 


MAX(B25+F38,C25+E38,D25+D38,E25+C38,F25+B38) 


162 

with d3(4)= 

3 

51 


1 





52 

m3(3)=max[f3(0)+m4(3-0), f3(1)+m4(3-1), f3(2)+m4(3-2), f3(3)+m4(3-3 

)] 




53 


MAX(B25+E38,C25+D38,D25+C38,E25+B38) 


153 

with d3(3)= 

2 

54 


1 





55 

m3(2)=max[f3(0)+m4(2-0), f3(1)+m4(2-1), f3(2)+m4(2-2); 






56 


MAX(B25+D38,C25+C38,D25+B38) 



143 

with d3(2)= 

1 

57 









58 

m3(1 )=max[f3(0)+m4(1 -0), f3(1 )+m4(1 -1)] 







59 


MAX(B25+C38,C25+B38) 




132 

with d3(1)= 

1 

60 










61 

m3(0)=max[f3(0)+m4(0-0)] 








62 

MAX(B25+B38) 




120 

with d3(0)= 

0 


continued on the next page. 
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Solutions to End-of-Chapter Exercises 



A 

B 

C 

D 

II E 

F 

G 

H 

1 

63 










64 

These values are now added to the table above, Rows 40 and 41 





65 







66 

Similarly, we compute the values of m2(u) and d2(u) 






67 







68 

m2(4)=max[f2(0)+m3(4-0), f2(1)+m3(4-1), f2(2)+m3(4-2), f2(3)+m3(4-3), f2(4)+m3(4-4)] 



69 


MAX(B24+F40,C24+E40,D24+D40,E24+C40,F25+B40) 


202 

with d2(4)= 

0 

70 







71 

m2(3)=max[f2(0)+m3(3-0), f2(1)+m3(3-1), f2(2)+m3(3-2), f2(3)+m3(3-3)] 




72 


MAX(B24+E40,C24+D40,D24+C40,E24+B40) 


193 

with d2(3)= 

0 

73 







74 

m2(2)=max[f2(0)+m3(2-0), f2(1)+m3(2-1), f2(2)+m3(2-2) 






75 


MAX(B24+D40,C24+C40,D24+B40) 



183 

with d2(2)= 

0 

76 









77 

m2(1)=max[f2(0)+m3(1-0), f2(1)+m3(1-1)] 







78 


MAX(B24+C40,C24+B40) 




172 

with d2(1)= 

0 

79 










80 

m2(0)=max[f2(0)+m3(0-0)] 








81 


MAX(B24+B40) 




160 

with d2(0)= 

0 

82 









83 

These values are added to the table above, Rows 42 and 43 





84 






85 

Stage 1 is the last stage and there is only one state associated with it, u=4, and thus 




86 





87 

m1(4)=max[f1(0)+m2(4-0), f1(1)+m2(4-1), fl (2)+m2(4-2), f1(3)+m2(4-3), fl (4)+m2(4-4)] 



88 


MAX(B23+F42,C23+E42,D23+D42,E23+C42,F23+B42) 


248 

with d 1(4)= 

2 

89 







90 

These two values are the last entries into the table in Cells F44 and F45 




91 





92 

The table (Rows 36 through 45) indicates that, to achieve the maximum sum of commissions, 



93 

the salesman should spend 2 hours with Customer #1 (d1(4)=2), 0 hours with Customer #2 



94 

(d2(4)=0), and for the remaining 2 hours he should spend 1 hour with Customer #3 and 1 



95 

hour with Customer #4. 








96 










97 

Check: 









98 


Customer #1,2 hours = 


$65 





99 


Customer #2, 0 hours = 


$40 





100 


Customer #3, 1 hour = 


$52 





101 


Customer #4, 1 hour = 


$91 





102 


Total = 


$248 






Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 


16-27 










































































Chapter 16 Optimization Methods 



min[A —> B, A->C] = min[30, 20] = 20 A-> C 
min[A —» B, C -+ D, C -+ F] = min[30, 50, 40] = 30 A^B 
min[B —> D, B -> E, C^D, C -» F] = min[40, 50, 50, 40] = 40 choose B —> D 
min[B —> E, D —> E, D -» F, C —> F] = min[50, 90, 50, 40] =40 CF 
min[B —> E, D^E, F^E] = min[50, 90, 70] = 50 B —> E 



and thus the minimum distance is 20 + 30 + 40 + 40 + 50 = 180 kilometers 
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Appendix A 


Difference Equations in Discrete-Time Systems 


T his appendix is a treatment of linear difference equations with constant coefficients and it is 
confined to first- and second-order difference equations and their solution. Higher-order 
difference equations of this type and their solution is facilitated with the ^-transform. 

A. 1 Recursive Method for Solving Difference Equations 

In mathematics, a recursion is an expression, such as a polynomial, each term of which is deter¬ 
mined by application of a formula to preceding terms. The solution of a difference equation is 
often obtained by recursive methods. An example of a recursive method is Newton’s method^ for 
solving non-linear equations. While recursive methods yield a desired result, they do not provide 
a closed-form solution. If a closed-form solution is desired, we can solve difference equations 
using the Method of Undetermined Coefficients, and this method is similar to the classical 
method of solving linear differential equations with constant coefficients. This method is 
described in the next section. 

A.2 Method of Undetermined Coefficients 

A second-order difference equation has the form 

y( n ) + a x y(n - 1) + a 2 (n - 2) = f(n) (A.l) 

where a, and a 2 are constants and the right side is some function of n . This difference equation 
expresses the output y(n) at time n as the linear combination of two previous outputs y(n- 1) 
and y(n - 2). The right side of relation (A.l) is referred to as the forcing function. The general 
(closed-form) solution of relation (A.l) is the same as that used for solving second-order differen¬ 
tial equations. The three steps are as follows: 

1. Obtain the natural response (complementary solution) y c (n) in terms of two arbitrary real 
constants k, and k 2 , where a, and a 2 are also real constants, that is, 

y c (n) = kiai + k 2 a 2 (A.2) 

2. Obtain the forced response (particular solution) y P (n) in terms of an arbitrary real constant k 3 , 


* For an introduction and applications of the %>-transform please refer to Signals and Systems with MATLAB 
Computing and Simulink Modeling, Third Edition, ISBN 0-9744239-9-8. 
t Newton’s method is discussed in Chapter 2. 
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that is, 

y P ( n ) = k 3 a” (A. 3) 

where the right side of (A.3) is chosen with reference to Table A.l. 


TABLE A. I Forms of the particular solution for different forms of the forcing function 


Form of forcing function 

Form of particular solution 5 

Constant 

k - a constant 

an - a is a constant 

k 0 + kjn + k 2 n“ + ... + k k n - k ; is constant 

ab ±n - a and b are constants 

Expression proportional to b ±n 

acos(nco) or asin(nco) 

kjcos(nco) + k 2 sin(nco) 


a. As in the case with the solutions of ordinary differential equations with con¬ 
stant coefficients, we must remember that if f(n) is the sum of several terms, 
the most general form of the particular solution y P (n) is the linear combina¬ 
tion of these terms. Also, if a term in y P (n) is a duplicate of a term in the com¬ 
plementary solution y c (n), we must multiply y P (n) by the lowest power of n 
that will eliminate the duplication. 

3. Add the natural response (complementary solution) y c (n) and the forced response (particular 
solution) y P (n) to obtain the total solution, that is, 

y(n) = y c ( n ) + yp( n ) = + k 2 a 2 + y P (n) (A.4) 

4. Solve for kj and k 2 in (A.4) using the given initial conditions. It is important to remember 
that the constants k, and k 2 must be evaluated from the total solution of (A.4), not from the 
complementary solution y c (n). 

It is best to illustrate the Method of Undetermined Coefficients via examples. 


Example A. 1 

Find the total solution for the second-order difference equation 

y(n)-|y(n-l) + gy(n-2) = 5 _n n>0 (A.5) 

subject to the initial conditions y(-2) = 25 and y(-l) = 6. 

* Ordinary differential equations with constant coefficients are discussed in Chapter 5. 
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Method of Undetermined Coefficients 


Solution: 

1. We assume that the complementary solution y c (n) has the form 
y c (n) = kja” + k 2 a 2 

The homogeneous equation of (A. 5) is 


Substitution of y(n) = a into (A.7) yields 


Division of (A.8) by a“ 2 yields 
The roots of (A. 9) are 


2 5 1 n 

a--a + - = 0 


a,s- a 2 = - 

1 2 2 3 


and by substitution into (A.6) we obtain 


y c (n) = k i(| ) n + k2 (| ) n = k i2 -n + k 2 3- n 


2. Since the forcing function is 5 ", we assume that the particular solution is 
y P (n) = k 3 5" n 


and by substitution into (A.5), 


k = 5 ‘"- k =tl) r< "“ >+k >(l) 5 " < " 2> = 5 "‘ 

Division of both sides by 5~ n yields 

“fe-dMg) 51 ] - 1 

or k 3 = 1 and thus 

y P ( n ) = 5" n 

The total solution is the addition of (A. 11) and (A. 13), that is, 
y( n ) = y c (n) + y P (n) = k {T* + k 2 3 _n + 5 _n 


(A.6) 

(A. 7) 

(A.8) 

(A.9) 

(A. 10) 

(A. 11) 

(A. 12) 


(A. 13) 

(A. 14) 
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To evaluate the constants k, and k 2 we use the given initial conditions, i.e., s y(-2) = 25 and 
y(-l) = 6 . For n = -2, (A. 14) reduces to 


from which 

For n = -1, (A. 14) reduces to 
from which 


y(-2) = kj2 + k 2 3 + 5 = 25 
4k! + 9k 2 = 0 


y(—1) = k 1 2 1 + k 2 3 1 + 5 1 = 6 


2k! + 3k 2 = 1 

Simultaneous solution of (A. 15) and (A. 16) yields 


k, = 


k 2 = -r 


2 " 3 

and by substitution into (A. 14) we obtain the total solution as 

y(n) = y c (n) + y P (n) = ( |) 2 ~” + (-| ) 3"” + 5"” n > 0 


(A. 15) 

(A. 16) 

(A. 17) 

(A. 18) 


To plot this difference equation for the interval 0 < n < 10, we use the following MATLAB 
script: 

n=0:1:10; yn=1.5.*2. A (~n)~(2V3).*3. A (-n)+5. A (~n); stem(n,yn); grid 

The plot is shown in Figure A.l. 
















































T , 

!> 1 1 



Figure A. 1. Plot for the difference equation of Example A. 1 
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Method of Undetermined Coefficients 


Example A. 2 

Find the total solution for the second-order difference equation 

y(n) — ^y(n — 1) + ^y(n — 2) = 1 + 3 _n n>0 (A. 19) 

subject to the initial conditions y(-2) = 0 and y(-l) = 2 

Solution: 

1. We assume that the complementary solution y c (n) has the form 

y c (n) = k l a'l + k 2 a 2 (A.20) 

The homogeneous equation of (A. 19) is 

y(n) - |y(n - 1) + |y(n - 2) = 0 n > 0 (A.21) 

Substitution of y(n) = a into (A.21) yields 

a" 1- |a n 1 + \ &n 2 = 0 ( A - 22 ) 

Division of (A.22) by a 11-2 yields 

a 2 -|a+i = 0 (A.23) 

The roots of (A.23) are 

a, = \ a 2 = 1 (A. 24) 

and by substitution into (A.20) we obtain 

y c (n) = k 1 (^) n + k 2 (l)" = k|2~” + k 2 (A.25) 

2. Since the forcing function is 1 + 3 _n , in accordance with the first and third rows of Table A.l, 
we would assume that the particular solution is 

y P (n) = k 3 + k 4 3~ n (A.26) 

However, we observe that both relations (A.25) and (A.26) contain common terms, that is, the 
constants k 2 and k 3 . To avoid the duplication, we choose the particular solution as 

y P (n) = k 3 n + k 4 3~ n (A.27) 

and by substitution of (A.27) into (A. 19) we obtain 
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k 3 n + k 4 3- n -(|)k3(n-l)-(|)k 4 3- (n - 1) + ik 3 (n-2) + (i)k 4 3- (n - 2) =1 + 3-” 
k 3 n + k43^-Q)k 3 n+Q)k 3 -£! )k 4 3” n +|k 3 n-k 3 + (J )k 4 3“ n = 1 + 3~ n 


k43_n + (|) k 3- k 3 = 1 + 3" 1 

Equating like terms, we obtain 



and after simplification, 

By substitution into (A.27), 


k 4 3' n = 3~ n 


k 3 = 2 k 4 = 1 


y P (n) = 2n + 3" n 

The total solution is the addition of (A.25) and (A.28), that is, 


(A.28) 


y(n) = y c (n) + y P (n) = k 3 2 11 + k 2 + 2n + 3~ n (A.29) 

To evaluate the constants k 3 and k 2 we use the given initial conditions, i.e., s y(-2) = 0 and 
y(-l) = 2. For n = -2, (A.29) reduces to 

y(-2) = kj2 2 + k 2 - 4 + 9 = 0 

from which 


For n = -1, (A.29) reduces to 

y(-l) = k 1 2 1 + k 2 -2 + 3 1 = 2 

from which 

2k! + k 2 = 1 

Simultaneous solution of (A.30) and (A.31) yields 
k x = -3 k 2 = 7 

and by substitution into (A.29) we obtain the total solution as 


(A.30) 


(A.31) 

(A.32) 
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y(n) = y c (n) + y P (n) = (-3)2~ n + 7 + 2n + 3~ n n > 0 (A.33) 

To plot this difference equation for the interval 0<n< 10, we use the following MATLAB 
script: 

n=0:1:10; yn=(-3).*2. A (-n)+7+2.*n+3. A (-n); stem(n,yn); grid 



Figure A.2. Plot for the difference equation of Example A.2 


Example A.3 

Find the total solution for the first-order difference equation 

y(n) - 0.9y(n -1) = 0.5 + (0.9) n_1 n>0 (A.34) 

subject to the initial condition y(-l) = 5 

Solution: 

1. We assume that the complementary solution y c (n) has the form 


y c (n) = kja n 

(A.35) 

The homogeneous equation of (A.34) is 


y(n) - 0.9y(n-1) = 0 n>0 

(A. 3 6) 

Substitution of y(n) = a” into (A.35) yields 


a 11 - 0.9a”" 1 = 0 

(A.37) 
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Division of (A.37) by a°~ 1 yields 

a-0.9 = 0 

a = 0.9 (A.38) 

and by substitution into (A.35) we obtain 

y c (n) = kdO.9) 11 (A.39) 

2. Since the forcing function is 0.5 + (0.9) n_1 , in accordance with the first and third rows of 
Table A.l, we would assume that the particular solution is 

yp( n ) = k 2 + k 3 (0.9) n (A.40) 

However, we observe that both relations (A.39) and (A.40) contain common terms, that is, 
the constants k,(0.9) n and k 3 (0.9) n . To avoid the duplication, we choose the particular solu¬ 
tion as 

y P (n) = k 2 + k 3 n(0.9) n (A.41) 

and by substitution of (A.41) into (A.34) we obtain 

k 2 + k 3 n(0.9) n -0.9k 2 -0.9k 3 (n-l)(0.9) (n ~ n = 0.5 + (0.9) nl 
0.1k 2 + k 3 n(0.9) n - 0.9k 3 n(0.9) (n ~ 1) + 0.9k 3 (0.9) (n_1) = 0.5 + (0.9) n 1 
0.1k 2 + k 3 n(0.9) n -0.9k 3 n(0.9) n 0.9 1 +0.9k 3 (0.9) n 0.9 1 = 0.5 + (0.9 ) n_1 
0.1k 2 + k 3 n(0.9) n - k 3 n(0.9) n + k 3 (0.9) n = 0.5 + (0.9 ) n_1 = 0.5 + (0.9) _ 1 (0.9) n 
Equating like terms, we obtain 

0.1 k 2 = 0.5 

k 3 (0.9)“ = (0.9) _1 (0.9) n 

and after simplification, 

k 2 = 5 k 3 = 10 

9 

By substitution into (A.41), 

y P (n) = 5 + ^n(0.9) n (A.42) 

The total solution is the addition of (A.39) and (A.42), that is, 

y( n ) = y c (n) + y P (n) = k 1 (0.9) n + yn(0.9) n + 5 (A.43) 
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To evaluate the constant k, we use the given initial condition, i.e., y(-l) = 5. For n = -1, 
(A.43) reduces to 

y(-l) = k 1 (0.9 )- 1 + ^(-l)(0.9)-' + 5 = 5 

10 100 = o 

9 kl 81 

from which 

C = f (A. 44) 

and by substitution into (A.43) we obtain the total solution as 
y(n) = (0.9) n_ 1 + n(0.9 )“~ 1 + 5 

y(n) = (n + l)(0.9 ) n_1 + 5 n>0 (A. 45) 

To plot this difference equation for the interval 0<n< 10, we use the following MATLAB 
script: 

n=0:1:10; yn=(n+1).*(0.9). A (n-1)+5; sfem(n,yn); grid 



Example A.4 

Find the total solution for the second-order difference equation 

y(n) - 1.8y(n- 1 ) + 0.81y(n-2) = 2 -n n>0 (A.46) 
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subject to the initial conditions y(-2) = 25 and y(-l) = 6 

Solution: 

No initial conditions are given and thus we will express the solution in terms of the unknown 
constants. 


1. We assume that the complementary solution y c (n) has the form 
y c (n) = kja” + k 2 a“ 

The homogeneous equation of (A.46) is 

y(n) - 1.8y(n-1) + 0.81y(n - 2) = 0 n>0 

Substitution of y(n) = a n into (A.48) yields 

a n -1.8a I1 ~ 1 + 0.81a n ~ 2 = 0 
Division of (A.49) by a 11 " 2 yields 

a 2 - 1.8a + 0.81 = 0 

The roots of (A.50) are repeated roots, that is, 
a! = a 2 = 0.9 


(A.47) 

(A.48) 

(A.49) 

(A.50) 

(A.51) 


and as in the case of ordinary differential equations, we accept the complementary solution to 
be of the form 


y c (n) = kj(0.9) n + k 2 n(0.9) n 

2. Since the forcing function is T ", we assume that the particular solution is 
y P (n) = k 3 2~ n 

and by substitution into (A.46), 

k 3 2” n -k 3 (1.8)2 _(n ~ 1) + k 3 (0.81)2 _(n_2) = 2‘ n 
Division of both sides by 2~" yields 

k 3 [l -(1.8)2 + (0.81)2 2 ] = 1 
k 3 [l-3.6+ 3.24] = 1 
1 25 


(A.52) 


(A.53) 


k 3 = - 


0.64 16 
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and thus 

y p(n) = (fi) 2 ” (A - 54) 

The total solution is the addition of (A.52) and (A.54), that is, 

y( n ) = y c (n) + yp(n) = k 1 (0.9) n + k 2 n(0.9) n + ^Y^ ^2 (A.55) 


Example A. 5 

For the second-order difference equation 

y(n) - 1 . 8 y(n- 1 ) + 0.81y(n-2) = (0.9) n n >0 (A.56) 

what would be the appropriate choice for the particular solution? 

Solution: 

This is the same difference equation as that of Example A.4 where the forcing function is (0.9) n 
instead of 2 ~ n where we found that the complementary solution is 

y c ( n ) = kTO.9 ) 11 + k 2 n(0.9)“ (A.57) 

Row 3 in Table A.l indicates that a good choice for the particular solution would be k 3 (0.9) n . But 
this is of the same form as the first term on the right side of (A.57). The next choice would be a 
term of the form k 3 n(0.9) n but this is of the same form as the second term on the right side of 
(A.57). Therefore, the proper choice would be 

y P (n) = k 3 n 2 (0.9)“ (A.58) 


Example A.6 

Find the particular solution for the first-order difference equation 

y(n)-0.5y(n-l) = sin(^) n >0 (A.59) 

Solution: 

From Row 4 in Table A.l we see that for a sinusoidal forcing function, the particular solution has 
the form 

y P (n) = k^in^y) +k 2 cos(y) (A.60) 
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and by substitution of (A.60) into (A.59) 

kiSin (y) + k 2 cos(y) -0.5k!sin p n)7l j-0.5k 2 cos= sin(y) 

k, sin(^) + k 2 cos(^) - 0.5k, sin[^ _ 5] _ Q.S^cos = sin (y) (A.61) 

From trigonometry, 


Then, 


and by substitution into (A.61) 


■ [mi n~] ( mi 

Stn L~2 2 J = -C °vTy 


fim n~] ■ I mi 

c ° s ^___j = sm ^_ 


Equating like terms, we obtain 

kj - 0.5k 2 = 1 
0.5k] + k 2 = 0 

and simultaneous solution of (A. 63) and (A. 64) yields 
k - - k - 

k i - 5 K 2 - 

Therefore, the particular solution of (A.59) is 
4 . fnn 

: 5 Sm l TJ 5~ 


(A.62) 

(A. 63) 
(A. 64) 


(A.65) 
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Appendix B 


Introduction to Simulink® 


T his appendix is a brief introduction to Simulink. This author feels that we can best intro¬ 
duce Simulink with a few examples. Some familiarity with MATLAB is essential in under¬ 
standing Simulink, and for this purpose, it is highly recommended that the novice to MAT- 
LAB reader reviews Chapter 1 which serves as an introduction to MATLAB. 

B. 1 Simulink and its Relation to MATLAB 

The MATLAB® and Simulink® environments are integrated into one entity, and thus we can 
analyze, simulate, and revise our models in either environment at any point. We invoke Simulink 
from within MATLAB. We will introduce Simulink with a few illustrated examples. 


Example B. 1 

For the circuit of Figure B.l, the initial conditions are i L ( 0 ~) = 0 , and v c ( 0 ~) = 0.5 V. We will 
compute v c (t). 


R 


L 



^s(t) = u 0 (t) 

Figure B. 1. Circuit for Example B. 1 


For this example, 



(B.l) 


and by Kirchoff s voltage law (KVL), 



(B.2) 


Substitution of (B.l) into (B.2) yields 
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(B.3) 


Substituting the values of the circuit constants and rearranging we obtain: 




(B.4) 



(B.5) 


To appreciate Simulink’s capabilities, for comparison, three different methods of obtaining the 
solution are presented, and the solution using Simulink follows. 

First Method - Assumed Solution 

Equation (B.5) is a second-order, non-homogeneous differential equation with constant coeffi¬ 
cients, and thus the complete solution will consist of the sum of the forced response and the natu¬ 
ral response. It is obvious that the solution of this equation cannot be a constant since the deriva¬ 
tives of a constant are zero and thus the equation is not satisfied. Also, the solution cannot 
contain sinusoidal functions (sine and cosine) since the derivatives of these are also sinusoids. 
However, decaying exponentials of the form ke _at where k and a are constants, are possible candi¬ 
dates since their derivatives have the same form but alternate in sign. 

It can be shown* that if kje Slt and k 2 e ^ where kj and k 2 are constants and s, and s 2 are the 
roots of the characteristic equation of the homogeneous part of the given differential equation, 
the natural response is the sum of the terms kje 1 and k 2 e 2 . Therefore, the total solution will 


be 


v c (t) = natural response + forced response = v cn (t) + v cf (t) = k x e 1 +k 2 e 2 +v cf (t) (B.6) 


The values of Sj and s 2 are the roots of the characteristic equation 


* Please refer to Circuit Analysis II with MATLAB Applications, ISBN 0-9709511-5-9, Appendix B for a 
thorough discussion. 
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s + 4s + 3 = 0 (B.7) 

Solution of (B.7) yields of S! = -1 and s 2 = -3 and with these values (B.6) is written as 

v c (t) = k 1 e _t + k 2 e _3t +v cf (t) (B.8) 

The forced component v cf (t) is found from (B.5), i.e., 

^ + 4^ + 3v c = 3 t > 0 (B.9) 

dt 2 dt 

Since the right side of (B.9) is a constant, the forced response will also be a constant and we 
denote it as v Cf = k 3 . By substitution into (B.9) we obtain 

0 + 0 +3k 3 = 3 


vrf = k, = 1 


(B.10) 


v cf - : 

Substitution of this value into (B.8), yields the total solution as 

v c (t)= v Cn (t) + v Cf = kje -1 + k 2 e _3t + 1 (B .11) 

The constants kj and k 2 will be evaluated from the initial conditions. First, using v c (0) = 0.5 V 
and evaluating (B.l 1) at t = 0, we obtain 


kj + k 2 = -0.5 


Also, 


v c uv c _ 'l 


(B.12) 


dvcl 

dt 


C C 


(B.13) 


Next, we differentiate (B. 11), we evaluate it at t = 0, and equate it with (B.13). Thus, 
dv,d 

-A =- kl -3k 2 


(B.14) 


By equating the right sides of (B.13) and (B.14) we obtain 
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-kj-3k 2 = 0 (B.15) 

Simultaneous solution of (B.12) and (B.15), gives k, = -0.75 and k 2 = 0.25 . By substitution into 
(B.8), we obtain the total solution as 


v c (t) = (-0.75e 1 + 0.25e 3t + l)u 0 (t) 


(B.16) 


Check with MATLAB: 
syms t 

y0=-0.75*exp(-t)+0.25*exp(-3*t)+1; 

y1=diff(y0) 

yi = 

3 / 4 * exp (-1) - 3 / 4 * exp (- 3 * t) 

y2=diff(y0,2) 

y2 = 

-3/4*exp(-t)+9/4*exp(— 3 * t) 
y=y2+4*y1 +3*y0 

y = 

3 


% Define symbolic variable t 
% The total solution y(t), for our example, vc(t) 
% The first derivative of y(t) 


% The second derivative of y(t) 


% Summation of y and its derivatives 


Thus, the solution has been verified by MATLAB. Using the expression for v c (t) in (B.16), we 
find the expression for the current as 



Figure B.2. Transformed Circuit for Example B.l 


(B.17) 
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By the voltage division expression, 


v f x 3/4s (l 0.5^ 0.5 _ 1.5 0.5 _ 0.5s 2 + 2s + 3 

Cl ' (1 + 0.25s+ 3/4s) As s ) s s ( s 2 + 4s + 3 ) s s(s+l)(s + 3) 

Using partial fraction expansion,^ we let 


0.5s 2 + 2s+ 3 = r i | U , r 3 
s(s + l)(s + 3) s (s+1) (s + 3) 


(B.18) 


0.5s 2 + 2s + 3 I 
(s+l)(s + 3)| g = 0 


r 2 


0.5s 2 + 2s + 3 1 
s(s + 3) | s = 


= -0.75 


= 0.5s 2 + 2s + 31 = Q25 

s(s + l) | s = _ 3 


and by substitution into (B.18) 


V c (s) = 


0.5s 2 + 2s+ 3 

s(s+ l)(s + 3) 


1 t -0,75 { 0.25 
s (s + 1) (s + 3) 


Taking the Inverse Laplace transform'®' we find that 


v c (t) = 1 - 0.75e i + 0.25 e 
Third Method - Using State Variables 


Ri L + + v c = u 0 (t) * 


* For derivation of the voltage division and current division expressions, please refer to Circuit Analysis I with 
MATLAB Applications, ISBN 0-9709511-2-4. 

t Partial fraction expansion is discussed in Chapter 12, this text. 

t For an introduction to Laplace Transform and Inverse Laplace Transform, please refer to Chapters 2 and 3, 
Signals and Systems with MATLAB Computing and Simulinl Modeling, ISBN 0-9744239-9-8. 

** Usually, in State—Space and State Variables Analysis, u(t) denotes any input. For distinction, we will denote 
the Unit Step Function as u 0 (t). For a detailed discussion on State-Space and State Variables Analysis, please 
refer to Chapter 5, Signals and Systems with MATLAB Computing and Simulinl Modeling, ISBN 0- 
9744239-9-8. 
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By substitution of given values and rearranging, we obtain 
^ = (-l)i L -v c+ l 


= - 4i L -4v c + 4 
dt L c 

Next, we define the state variables Xj = i L and x 2 = v c . Then, 


(B.19) 




x 1 = ^* 

dt 

(B.20) 

and 


dv c 

x 2 = — 1 
dt 

(B.21) 

Also, 


• r dv c 

L C dt 


and thus, 

x i 

_ i _ - Cx - *x 

- i L - C dt - Cx 2 - 3 x 2 


or 


3 

X 2 = 4 X ! 

(B.22) 

Therefore, from (B.19), (B.20), and 

(B.22), we obtain the state equations 




x x = -4xj -4x 2 + 4 




3 

X 2 = 4 x i 


and in matrix form, 

I- 

fc IB*!-" 

(B.23) 


Solution^ of (B.23) yields 


* The notation x (x dot) is often used to denote the first derivative of the function x, that is, x = dx/dt. 
t The detailed solution of (B.23) is given in Chapter 5, Signals and Systems with MATLAB Computing and 
Simulinl Modeling, ISBN 0-9744239-9-8. 
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x i 


-3t 


e -e 


x 2 j l-0.75e‘ + 0.25e 3t 


Then, 


-3t 


(B.24) 


xi = i L = e -e 


and 


x 2 = v c = 1 - 0.75e * + 0.25e 3t 


(B.25) 


Modeling the Differential Equation of Example B. 1 with Simulink 

To run Simulink, we must first invoke MATLAB. Make sure that Simulink is installed in your sys¬ 
tem. In the MATLAB Command prompt, we type: 

simulink 

Alternately, we can click on the Simulink icon shown in Figure B.3. It appears on the top bar on 
MATLAB’s Command prompt. 




Figure B.3. The Simulink icon 


Upon execution of the Simulink command, the Commonly Used Blocks appear as shown in Fig¬ 
ure B.4. 

In Figure B.4, the left side is referred to as the Tree Pane and displays all Simulink libraries 
installed. The right side is referred to as the Contents Pane and displays the blocks that reside in 
the library currently selected in the Tree Pane. 

Let us express the differential equation of Example B. 1 as 



(B.26) 


A block diagram representing relation (B.26) above is shown in Figure B.5. We will use Simulink 


to draw a similar block diagram. 


* Henceforth, all Simulink block diagrams will be referred to as models. 
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IH Commonly Used Blocks 
iH Continuous 
iHI Discontinuities 
iH Discrete 

in Logic and Bit Operations 
Lookup Tables 
iH| Math Operations 
iH Model Verification 
iH Model-Wide Utilities 
iH Ports & Subsystems 
Signal Attributes 
iH Signal Routing 
Sinks 

iH Sources 

iH User-Defined Functions 
Si i$J Additional Math & Discrete 
® Real-Time Workshop 
+■ $ Signal Processing Blockset 
+■ ^ SimPowerSystems 
.+i $$ Simulink Extras 


*■* Commonly Used Blocks 

dH Continuous 
ljp\| Discontinuities 
Discrete 

Logic and Bit Operations 
;+ L—‘] Lookup T ables 
, £3 Math Operations 
^ Model Verification 
Model-Wide Utilities 
^ Ports & Subsystems 
Signal Attributes 
.-jfisj Signal Routing 
Sinks 
Sources 

User-Defined Functions 
Additional Math 8c Discrete 


Figure B.4. The Simulink Library Browser 



Figure B.5. Block diagram for equation (B.26) 


To model the differential equation (B.26) using Simulink, we perform the following steps: 

1. On the Simulink Library Browser, we click on the leftmost icon shown as a blank page on the 
top title bar. A new model window named untitled will appear as shown in Figure B.6. 
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Figure B.6. The Untitled model window in Simulink. 

The window of Figure B.6 is the model window where we enter our blocks to form a block dia¬ 
gram. We save this as model file name Equation_1_26. This is done from the File drop menu of 
Figure B.6 where we choose Save as and name the file as Equation_1_26. Simulink will add 
the extension .mdl. The new model window will now be shown as Equation_1_26, and all 
saved files will have this appearance. See Figure B.7. 



Figure B.7. Model window for Equation_l_26.mdl file 

2. With the Equation_1_26 model window and the Simulink Library Browser both visible, we 
click on the Sources appearing on the left side list, and on the right side we scroll down until 
we see the unit step function shown as Step. See Figure B.8. We select it, and we drag it into 
the Equation_1_26 model window which now appears as shown in Figure B.8. We save file 
Equation_l_26 using the File drop menu on the Equation_1_26 model window (right side of 
Figure B.8). 

3. With reference to block diagram of Figure B.5, we observe that we need to connect an ampli¬ 
fier with Gain 3 to the unit step function block. The gain block in Simulink is under Com¬ 
monly Used Blocks (first item under Simulink on the Simulink Library Browser). See Figure 
B.8. If the Equation_1_26 model window is no longer visible, it can be recalled by clicking on 
the white page icon on the top bar of the Simulink Library Browser. 

4. We choose the gain block and we drag it to the right of the unit step function. The triangle on 
the right side of the unit step function block and the > symbols on the left and right sides of 
the gain block are connection points. We point the mouse close to the connection point of the 
unit step function until is shows as a cross hair, and draw a straight line to connect the two 
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blocks. We double-click on the gain block and on the Function Block Parameters, we 
change the gain from 1 to 3. See Figure B.9. 


ulink 

Commonly Used Blocks 
Continuous 
Discontinuities 
Discrete 

Logic and Bit Operations 
Lookup Tables 
Math Operations 
Model Verification 
Model-Wide Utilities 
Ports & Subsystems 
Signal Attributes 
Signal Routing 
Sinks 

Sources- - 

User-Defined Functions 
Additional Math & Discrete 
il-Time Workshop 
lal Processing Blockset 
PowerSystems 
ulink Extras 

Figure B.8. 


D U # 


rm 


Constant 

Counter Free-Running 
Counter Limited 
I I 1!at I Digital Clock 
From File 

I I From Workspace 
S Ground 

CD l"1 

|jlflj Pulse Generator 
Ramp 

Random Number 
Repeating Sequence 
Repeating Sequence Interpolated 
Repeating Sequence Stair 
| B’- 11 1 Signal Builder 
Signal Generator 
Sine Wave 


w 11 A. I I Iniform Ranrtnm kliimhpr 

Dragging the unit step function into File Equation_l_26 





Figure B.9. File Equation_l_26 with added Step and Gain blocks 


* An easy method to interconnect two Simulink bbcks is by clicking on the source block to select it, then holding 
down the Ctrl key, and left-clicking on the destination block. 
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5. Next, we need to add a thee-input adder. The adder block appears on the right side of the 
Simulink Library Browser under Math Operations. We select it, and we drag it into the 
Equation_1_26 model window. We double click it, and on the Function Block Parameters 
window which appears, we specify 3 inputs. We then connect the output of the of the gain 
block to the first input of the adder block as shown in Figure B. 10. 



Figure B.10. File Equation_l_26 with added gain block 

6. From the Commonly Used Blocks of the Simulink Library Browser, we choose the Integra¬ 
tor block, we drag it into the Equation_1_26 model window, and we connect it to the output 
of the Add block. We repeat this step and to add a second Integrator block. We click on the 
text “Integrator” under the first integrator block, and we change it to Integrator 1. Then, we 
change the text “Integrator 1” under the second Integrator to “Integrator 2” as shown in Fig¬ 
ure B.ll. 


_JT1 

Step Gainl | s | \ * \ 

Add Integratorl Integrators 

Figure B.ll. File Equation_l_26 with the addition of two integrators 


7. To complete the block diagram, we add the Scope block which is found in the Commonly 
Used Blocks on the Simulink Library Browser, we click on the Gain block, and we copy and 
paste it twice. We flip the pasted Gain blocks by using the Flip Block command from the For¬ 
mat drop menu, and we label these as Gain 2 and Gain 3. Finally, we double-click on these 
gain blocks and on the Function Block Parameters window, we change the gains from to -4 
and -3 as shown in Figure B.12. 



Figure B.12. File Equation_l_26 complete block diagram 
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8. The initial conditions i L (0 ) = C(dv c /dt) = 0 , and v c (0 ) = 0.5 V are entered by 

double clicking the Integrator blocks and entering the values 0 for the first integrator, and 0.5 
for the second integrator. We also need to specify the simulation time. This is done by specify¬ 
ing the simulation time to be 10 seconds on the Configuration Parameters from the Simula¬ 
tion drop menu. We can start the simulation on Start from the Simulation drop menu or by 

clicking on the-icon. 


9. To see the output waveform, we double click on the Scope block, and then clicking on the 


Autoscale 


ft 


icon, we obtain the waveform shown in Figure B.13. 



Figure B.13. The waveform for the function v c (t) for Example B.l 


Another easier method to obtain and display the output v c (t) for Example B.l, is to use State- 
Space block from Continuous in the Simulink Library Browser, as shown in Figure B.14. 


m—[ 


Step State-Space 

Step lime = 0 A= [-4 -4; 3/4 0] 
B=[4 0]' 

C=[0 1] D=[0] 

Initial Conditions [xl x2] 
specified in MATLAB's 
command prompt 


The annotations in this block were 
added manually as follows: 

We double-clicked on this unoccupied 
area of the model, and when a small 
rectangle appeared and the cursor 
changed to an insertion point, we began 
typing the desired information. To start a 
new line, we pressed the Enter key. 

We will follow this practice occasionally. 


Figure B.14. Obtaining the function v c (t) for Example B.l with the State-Space block. 
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The simout To Workspace block shown in Figure B.14 writes its input to the workspace. The 
data and variables created in the MATLAB Command window, reside in the MATLAB Work¬ 
space. This block writes its output to an array or structure that has the name specified by the 
block's Variable name parameter. This gives us the ability to delete or modify selected variables. 
We issue the command who to see those variables. From Equation B.23, Page B-6, 

AIM-"’ 


The output equation is 
or 


We double-click on the State-Space block, and in the Functions Block Parameters window we 
enter the constants shown in Figure B.15. 



Figure B. 15. The Function block parameters for the State-Space block. 


y = Cx + du 
y = [0 1] Xl +[0]u 
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The initials conditions [xl x2]' are specified in MATLAB’s Command prompt as 
x1=0; x2=0.5; 

As before, to start the simulation we click clicking on the — icon, and to see the output wave- 

form, we double click on the Scope block, and then clicking on the Autoscale icon, we 
obtain the waveform shown in Figure B.16. 



Figure B.16. The waveform for the function v c (t) for Example B.l with the State—Space block. 


The state-space block is the best choice when we need to display the output waveform of three or 
more variables as illustrated by the following example. 


Example B.2 

A fourth-order network is described by the differential equation 

+ a 2 ^ + + a 0 y(t) = u(t) (B.27) 

dt 4 dt 3 dt 2 dt 

where y(t) is the output representing the voltage or current of the network, and u(t) is any input, 
and the initial conditions are y(0) = y'(0) = y"(0) = y"'(0) = 0. 

a. We will express (B.27) as a set of state equations 


B-14 


Numerical Analysis Using MATLAB® and Excel®, Third Edition 
Copyright ® Orchard Publications 









Simulink and its Relation to MATLAB 


b. It is known that the solution of the differential equation 

^f + 2^ + y(t) = sint (B.28) 

dt dt“ 

subject to the initial conditions y(0) = y'(0) = y"(0) = y"'(0) = 0 , has the solution 

y(t) = 0.125 [(3 -1 2 ) - 3tcost] (B.29) 

In our set of state equations, we will select appropriate values for the coefficients 
a 3 , a 2 , a h and a 0 so that the new set of the state equations will represent the differential equa¬ 
tion of (B.28), and using Simulink, we will display the waveform of the output y(t). 

1. The differential equation of (B.28) is of fourth-order; therefore, we must define four state vari¬ 
ables that will be used with the four first-order state equations. 

We denote the state variables as x b x 2 , x 3 , and x 4 , and we relate them to the terms of the 
given differential equation as 


= y(t) 

We observe that 


, = & 

2 dt 


, = d_y 
dt 2 


. = A_y 

dt 3 


dt 4 


x 4 = -a 0 x 1 -a 1 x 2 -a 2 x 3 -a 3 x 4 + u(t) 


and in matrix form 


X t 


0 10 0 

0 0 10 

0 0 0 1 

—a 0 —a 3 —a 2 —a 3 


In compact form, (B.32) is written as 

x = Ax + bu 

Also, the output is 

y = Cx + du 

where 


u(t) 


(B.30) 


(B.31) 


(B.32) 


(B.33) 

(B.34) 
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*1 


0 

1 

0 

0 


Xi 


0 

X 2 

, A = 

0 

0 

1 

0 

, X = 

X 2 

, b = 

0 

x 3 


0 

0 

0 

1 


x 3 


0 

*4 


-a 0 

_a l 

-a 2 

— a 3 


X 4 _ 


1 


and u = u(t) 


and since the output is defined as 
relation (B.34) is expressed as 


y(t) = X! 


(B.35) 


y 


[1 0 0 0 ]- 


- [0]u(t) 


(B.36) 


2. By inspection, the differential equation of (B.27) will be reduced to the differential equation of 
(B.28) if we let 


a 3 = 0 a 2 = 2 a L = 0 a 0 = 1 u(t) = sint 
and thus the differential equation of (B.28) can be expressed in state-space form as 


where 


*1 


0 

1 

0 

0 

Xi 


0 

x 2 

_ 

0 

0 

1 

0 

x 2 

+ 

0 

x 3 


0 

0 

0 

1 

x 3 


0 

x 4 


-a 0 

0 

-2 

0 

x 4 


1 



x. 


0 1 

0 

0 


x i 


0 

x = 

x 2 

, A = 

0 0 

1 

0 

, x = 

x 2 

, b = 

0 


x 3 


0 0 

0 

1 


x 3 


0 


x 4 _ 


-a 0 0 

-2 

0 


x 4 


1 


and u = sint 


Since the output is defined as 
in matrix form it is expressed as 


y(t) = X! 


(B.37) 


(B.38) 
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y = [1 0 0 0] ■ 


(B.39) 


We invoke MATLAB, we start Simulink by clicking on the Simulink icon, on the Simulink 
Library Browser we click on the Create a new model (blank page icon on the left of the top 
bar), and we save this model as Example_1_2. On the Simulink Library Browser we select 
Sources, we drag the Signal Generator block on the Example_1_2 model window, we click 
and drag the State-Space block from the Continuous on Simulink Library Browser, and we 
click and drag the Scope block from the Commonly Used Blocks on the Simulink Library 
Browser. We also add the Display block found under Sinks on the Simulink Library 
Browser. We connect these four blocks and the complete block diagram is as shown in Figure 

B.17. 


Signal 

Generator 


x'= Ax+Bu 
y = Cx+Du 


State-Space 





-»| I -0.99^Jl | 

Display 


Figure B.17. Block diagram for Example B.2 


We now double-click on the Signal Generator block and we enter the following in the Func¬ 
tion Block Parameters: 

Wave form: sine 


Time (t): Use simulation time 
Amplitude: 1 
Frequency: 2 
Units: Hertz 

Next, we double-click on the state-space block and we enter the following parameter values 
in the Function Block Parameters: 

A: [0 1 0 0; 0 0 1 0; 0 0 0 1; -a0 -al -a2 -a3] 

B: [0 0 0 1]’ 

C: [1 0 0 0] 

D: [0] 

Initial conditions: xO 
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Absolute tolerance: auto 

Now, we switch to the MATLAB Command prompt and we type the following: 

>> a0=1; a1=0; a2=2; a3=0; x0=[0 0 0 0]’; 

We change the Simulation Stop time to 25 , and we start the simulation by clicking on the — 
icon. To see the output waveform, we double click on the Scope block, then clicking on the 

Autoscale ^ icon, we obtain the waveform shown in Figure B.18. 



Figure B.18. Waveform for Example B.2 

The Display block in Figure B.17 shows the value at the end of the simulation stop time. 


Examples B.l and B.2 have clearly illustrated that the State-Space is indeed a powerful block. We 
could have obtained the solution of Example B.2 using four Integrator blocks by this approach 
would have been more time consuming. 


Example B.3 

Using Algebraic Constraint blocks found in the Math Operations library, Display blocks found 
in the Sinks library, and Gain blocks found in the Commonly Used Blocks library, we will create 
a model that will produce the simultaneous solution of three equations with three unknowns. 

The model will display the values for the unknowns z,, z 2 , and z 3 in the system of the equations 

ajZj + a 2 z 2 + a 3 z 3 + k x = 0 

a 4 Zj + a 5 z 2 + a 6 z 3 + k 2 = 0 (B.40) 

a 7 Zj + a g z 2 + a 9 z 3 + k 3 = 0 
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The model is shown in Figure B.19. 





Figure B. 19. Model for Example B.3 

Next, we go to MATLAB’s Command prompt and we enter the following values: 

a1=2; a2=-3; a3=-1; a4=1; a5=5; a6=4; a7=-6; a8=1; a9=2;... 
k1=-8; k2=-7; k3=5; 

After clicking on the simulation icon, we observe the values of the unknowns as Zj = 2, 
z 2 = —3 , and z 3 = 5 .These values are shown in the Display blocks of Figure B.19. 

The Algebraic Constraint block constrains the input signal f(z) to zero and outputs an algebraic 
state z. The block outputs the value necessary to produce a zero at the input. The output must 
affect the input through some feedback path. This enables us to specify algebraic equations for 
index 1 differential/algebraic systems (DAEs). By default, the Initial guess parameter is zero. We 
can improve the efficiency of the algebraic loop solver by providing an Initial guess for the alge¬ 
braic state z that is close to the solution value. 
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Introduction to Simulink® 


An outstanding feature in Simulink is the representation of a large model consisting of many 
blocks and lines, to be shown as a single Subsystem block. For instance, we can group all blocks 
and lines in the model of Figure B.19 except the display blocks, we choose Create Subsystem 
from the Edit menu, and this model will be shown as in Figure B.20^ where in MATLAB’s Com¬ 
mand prompt we have entered: 


a1=5; a2=-1; a3=4; a4=11; a5=6; a6=9; a7=-8; a8=4; a9=15;... 
kl =14; k2=-6; k3=9; 



I -0-3121| 

Display 1 

I 

Display 2 
I -1-976 || 

Display 3 


Figure B.20. The model of Figure B.19 represented as a subsystem 


The Display blocks in Figure B.20 show the values of z x , z 2 , and z 3 for the values specified in 
MATLAB’s Command prompt. 


B.2 Simulink Demos 

At this time, the reader with no prior knowledge of Simulink, should be ready to learn Simulink’s 
additional capabilities. It is highly recommended that the reader becomes familiar with the block 
libraries found in the Simulink Library Browser. Then, the reader can follow the steps delineated 
in The MathWorks Simulink User’s Manual to run the Demo Models beginning with the thermo 
model. This model can be seen by typing 

thermo 

in the MATLAB Command prompt. 


* The Subsystem block is described in detail in Chapter 2, Section 2.1, Page 2—2, Introduction to Simulink with 
Engineering Applications, ISBN 0-9744239-7-1. 

f The contents of the Subsystem block are not lost. We can double-click on the Subsystem block to see its con¬ 
tents. The Subsystem block replaces the inputs and outputs of the model with Inport and Outport blocks. These 
blocks are described in Section 2.1, Chapter 2, Page 2-2, Introduction to Simulink with Engineering Applica¬ 
tions, ISBN 0-9744239-7-1. 
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Appendix C 


Ill-Conditioned Matrices 


T his appendix supplements Chapters 4 and 14 with concerns when the determinant of the 
coefficient matrix is small. We will introduce a reference against which the determinant can 
be measured to classify a matrix as a well- or ill-conditioned. 

C.l The Norm of a Matrix 

A norm is a function which assigns a positive length or size to all vectors in a vector space, other 
than the zero vector. An example is the two-dimensional Euclidean space denoted as R 2 . The 
elements of the Euclidean vector space (e.g., (2,5)) are usually drawn as arrows in a two-dimen¬ 
sional cartesian coordinate system starting at the origin (0,0). The Euclidean norm assigns to each 
vector the length of its arrow. 

The Euclidean norm of a matrix A, denoted as ||Aj|, is defined as 


M - Jt E A ?j 

and it is computed with the MATLAB function norm(A). 


(C.l) 


Example C. 1 

Using the MATLAB function norm(A), compute the Euclidean norm of the matrix A, defined as 

-2 5-49 
A = -3-6 8 1 

7-532 
4-9-8 -1 

Solution: 

At the MATLAB command prompt, we enter 

A=[-2 5 -4 9; -3 -6 8 1; 7 -5 3 2; 4 -9 -8 -1]; norm(A) 

and MATLAB outputs 
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ans = 

14.5539 


C.2 Condition Number of a Matrix 

The condition number of a matrix A is defined as 

k(A) = || A|, I A -1 1 (C.2) 

where ||A|| is the norm of the matrix A defined in relation (C.l) above. Matrices with condition 
number close to unity are said to be well-conditioned matrices, and those with very large condition 
number are said to be ill-conditioned matrices. 

The condition number of a matrix A is computed with the MATLAB function cond(A). 


Example C.2 

Using the MATLAB function cond(A), compute the condition number of the matrix A defined 
as 

-2 5-49 
A = -3 -6 8 1 

7-532 
4-9-8 -1 

Solution: 

At the MATLAB command prompt, we enter 

A=[-2 5 -4 9;-3 -6 8 1; 7 -5 3 2; 4 -9 -8 -1]; cond(A) 

and MATLAB outputs 

ans - 

2.3724 


This condition number is relatively close to unity and thus we classify matrix A as a well-condi¬ 
tioned matrix. 


We recall from Chapter 4 that if the determinant of a square matrix A is singular, that is, if 
det(A) = 0 , the inverse of A is undefined. Please refer to Chapter 4, Page 4-22. 
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Hilbert Matrices 


Now, let us consider that the coefficient matrix is very small, i.e., almost singular. Accordingly, 
we classify such a matrix as ill-conditioned. 


C.3 Hilbert Matrices 

Let n be a positive integer. A unit fraction is the reciprocal of this integer, that is, 1/n. Thus, 
1/1,1/2, 1/3, ... are unit fractions. A Hilbert matrix is a matrix with unit fraction elements 

By = l/(i+j-l) (C.3) 

Shown below is an example of the 5x5 Hilbert matrix. 


■ 1 

1 

1 

1 

1 ' 

1 

2 

3 

4 

5 

1 

2 

1 

3 

1 

4 

1 

5 

1 

6 

1 

3 

1 

4 

1 

5 

1 

6 

1 

7 

1 

4 

1 

5 

1 

6 

1 

7 

1 

8 

1 

_ 5 

1 

6 

1 

7 

1 

8 

1 

9 


* In general, a system with m linear equations and n unknowns can be written as 

a ll x l + a 12 x 2 + ••• +a ln x n = b l 
a 21 x l + a 22 x 2 + ••• +a 2n x n = b 2 

where x l5 x 2 , ..., x n are the unknowns and the numbers a n , a 12 , ..., a mn are the coefficients of the system. 
The coefficient matrix is the m x n matrix with the coefficient a^- as the (i,j)-th entry: 

a ll a 12 ••• a ln 
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MATLAB’s function hilb(n) displays the Hilbert n x n matrix. 


Example C.3 

Compute the determinant and the condition number of the 6x6 Hilbert matrix using MATLAB. 

Solution: 

At the MATLAB command prompt, we enter 

det(hilb(6)) 

and MATLAB outputs 
ans = 

5.3673e-018 

This is indeed a very small number and for all practical purposes this matrix is singular. 

We can find the condition number of a matrix A with the cond(A) MATLAB function. Thus, for 
the 6x6 Hilbert matrix, 

cond(hilb(6)) 

ans = 

1.4951e+007 

This is a large number and if the coefficient matrix is multiplied by this number, seven decimal 
places might be lost. 

Let us consider another example. 


Example C.4 

Let Ax = b where A = [°- 585 °- 379 l and b = M 
[0.728 0.464J [0.256J 


Compute the values of the vector x. 

Solution: 

Here, we are asked to find the values of Xj and x 2 of the linear system 


fo.585 0.379~| . x i = fo.l87l 
|_0.728 0.464J x 2 [o.256j 
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Using MATLAB, we define A and b, and we use the left division operation, i.e., 

A=[0.585 0.378; 0.728 0.464]; b=[0.187 0.256]'; x=b\A 

x = 

2.9428 1.8852 

Check: 

A=[0.585 0.378; 0.728 0.464]; x=[2.9428 1.8852]'; b=A*x 

b = 

2.4341 

3.0171 

but these are not the given values of the vector b, so let us check the determinant and the condi¬ 
tion number of the matrix A. 

determinant = det(A) 

determinant = 

-0.0037 

condition=cond(A) 

condition = 

328.6265 

Therefore, we conclude that this system of equations is ill-conditioned and the solution is invalid. 


Example C.4 above should serve as a reminder that when we solve systems of equations using 
matrices, we should check the determinants and the condition number to predict possible floating 
point and roundoff errors. 
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Symbolic Math Toolbox in MATLAB 12-4 
symmetric matrix - see matrix 
symmetry 6-7, 6-14,6-31 


Taylor series 5-24, 6-41, 6-44 
Taylor series expansion method 9-1 
text MATLAB command 1-14, 1-17 
third harmonic 6-1 
title(‘string’) in MATLAB 1-12 
trace of a matrix - see matrix 
transpose of a matrix - see matrix 
trapezoidal rule 10-1 
trapz(x,y) MATLAB function 10-3, 10-5 
Tree Pane in Simulink B-7 
Trendline Excel feature 8-9 
triangular waveform 6-11,6-19 
trigonometric Fourier series 6-1 
trigonometric relations 3-5 
two-dimensional plots 7-32 
type of a diferential equation 5-2 

U 

ultraspherical functions 15-22 

undetermined system 8-3 

unit fraction C-3 

unitary matrix - see matrix 

upper triangular matrix - see matrix 

V 

VLOOKUP Excel function 7-23 
W 

Wallis’s formulas 13-16 
Weber functions 15-7 
well-conditioned matrix - see matrix 
while end in MATLAB 2-4 
Wronskian determinant 5-10, 11-2 

X 

xlabel MATLAB command 1-12 
XY (Scatter) in Excel 8-6 

Y 

ylabel MATLAB command 1-12 


zero matrix - see matrix 
zeros 12-2 

zlabel MATLAB command 1-17 
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